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Description 

[0001] TTiis invention relates to a method and an apparatus for encoding of image signals by orthogonal transfor- 
mation. 

[0002] As a system for the high efficiency encoding of image signals, the Moving Picture Experts Group (MPEG) 
has proposed a draft standardization which prescribes a high efficiency encoding an-angement for picture signals for 
digital storage media. The storage media contemplated in the proposed arrangement are those having a continuous 
transfer rate of not higher than 1 .5 M bit/sec. such as a compact disc (CD), digital audio tape recorder (DAT) or a harcl 
disc. According to the draft standardization, the storage medium may be directly connected to a decoder or it may be 
connected thereto via a transmission medium such as a computer bus, local area network (LAN) or telecommunication 
link. It is contemplated by the draft standardization to implement special functions, such as random accessing, high- 
speed playback or reverse playback, in addition to the usual fbnward playback. 

[0003] In the arrangement proposed by MPEG for high efficiency encoding of picture signals, redundancy along the 
time axis is lowered by encoding the difference between pictures, and subsequently redundancy along the spatial axes 
is lowered by employing discrete cosine transform (DCT) and variable length encoding. 

[0004] With respect to redundancy along the time axis, in moving pictures, a picture under consideration, that is a 
picture at a given point in time, generally bears a strong resemblance to temporally previous and temporally posterior 
pictures. Consequently, if the difference between the picture now to be encoded and the picture temporally preceding it 
is taken and transmitted, as shown in Figure 44, then it becomes possible to lower the redundancy along time axis to 
diminish the volume of information to be transmitted. A picture encoded in this manner is termed a fbnwardly predictive- 
coded picture. P picture or a P frame. Similarly, if the difference is taken between the picture now to be encoded on the 
one hand and the picture temporally preceding it and the picture temporally succeeding it or interpolated pictures pro- 
duced from the preceding and succeeding pictures, and a smaller one of the resulting differences is transmitted, it 
becomes possible to lower further the redundancy along time axis to diminish the volume of information to be transmit- 
ted. The picture encoded in this manner is termed a bidirectlonally predictive-coded picture, B picture or a B frame. 
[0005] The pictures shown at I. P and B in Figure 44 represent an intra-coded picture, I picture or I frame, as later 
explained, as well as the above-mentioned P picture and B picture, respectively. 

[0006] The respective predicted pictures (referred to as predictive-coded pictures) are produced by so-called move- 
ment compensation. 

[0007] As an example of movement compensation, a block consisting of, for example, 16*16 pixels, which is 
formed of four unit blocks each of. for example, 8 * 8 pixels, is prepared. The 1 6 * 1 6 pixel block is termed a macro-block. 
The macro-block of the temporally previous picture in the vicinity of a given macro-block of a current picture exhibiting 
the least difference from the macro-block of the cun-ent picture Is found by searching, and a difference therebetween is 
taken to enable a reduction of the data to be transmitted. For the P-picture, a picture produced by taking the difference 
between the picture now to be encoded and the predicted picture following movement compensation or a picture pro- 
duced without taking the difference between the picture to be encoded and the predicted picture following movement 
compensation, whichever exhibits less data volume, is selected and encoded from one 16 * 16 pixel macro-block to 
another. 

[0008] However, in the above case, more data needs to be transmitted for a picture portion which has just emerged 
from behind an object which has been moved. For a B-picture, decoded temporally previous or temporally posterior pic- 
tures following movement compensation, an interpolated picture produced by adding these pictures, or a picture to be 
encoded, whichever is the least in data volume, is encoded. 

[0009] With respect to redundancy along spatial axes, the differences of the picture data are not directly transmit- 
ted, but are discrete cosine transformed from one 8 * 8 pixel block to another. The discrete cosine transform (OCT) 
expresses a picture not on the pixel level, but as a function of which of the frequency components of a cosine function 
are contained in a picture and the amounts of the frequency components contained in that picture. For example, data 
contained in a 8 * 8 pixel unit block are transformed by two-dimensional DCT into a block of 8 * 8 coefficients of the com- 
ponents of the cosine function. It is known that picture signals of a natural scene taken by a television camera tends to 
be smooth signals. In such case, the data volume may be efficiently diminished by discrete cosine transforming the pic- 
ture signals. 

[0010] Thus, in the case of smooth signals, such as picture signals of the natural scene, larger values are concen- 
trated about a certain coefficient. If the coefficient is quantized, the 8 * 8 coefficient block becomes substantially equal 
to zero, wNle larger coefficients are left. For transmitting data of the 8 * 8 coefficient block, non-zero coefficients and a 
zero run indicating how many Os are present in front of the coefficient are grouped into a set in the sequence of a so- 
called zig-zag scan, which set is transmitted as a Huffman code for diminishing the amount of information that needs to 
be transmitted. The image is re-constructed in the reverse sequence at the decoding side. 
[0011] The data structure handled by the above-described encoding an'angement is shown in Figure 45 and is 
comprised of a block layer, a macro-block layer, a slice layer, a picture layer, a group of pictures (GOP) layer and a video 
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picture or the frame is processed as a picture. 

[0026] US'A-5091 782 discloses a picture signal encoding device including orthogonal transformation of the picture. 
The picture is divided into blocks and orthogonal encoding is performed in parallel in both a field and a frame format, 
the output of one of the formats being selected in accordance with the errors detected in the data. The data comprises 
5 a control data bit for signalling whether field or frame formatting has been used. Motion compensation may be per- 
formed in some embodiments to achieve additional compression. It is perfomied In the same manner regardless of 
whether field or frame processing is chosen for encoding. 

[0027] The invention addresses the prot)lem of providing a high efficiency encoding technique for encoding picture 
signals whereby field or frame processing of a field-based video picture may be carried out efficiently regardless of 
10 whether the picture contains a subject that undergoes tittle motion or abundant motion. 
[0028] Various aspects of the invention are set out in the accompanying claims. 

[0029] Embodiments of the invention will now be described, by way of example only, with reference to the accom- 
panying drawings in which: 

15 Figure 1 is a block diagram showing a schematic arrangement of a high efficiency encoding apparatus; 
Figure 2 shows an example of macro-block; 

Figure 3 shows an example of macro-block for a frame processing mode; 
Figure 4 shows an example of macro-block for a field processing mode; 

Figure 5 is a block diagram showing an anangement of a high efficiency encoding device for picture signals of a 
20 second embodimenty " 

Figure 6 shows the manner of encoding by encoding devices of the first and second embodiments; 

Figure 7 shows a unit block for DCT of the frame processing mode/field processing mode for a typical format of a 

digital VTR; 

Figure 8 shows the manner of motion predkition in Figure 7; 
25 Figure 9 shows a modification of Figure 7; 

Figure 1 0 shows the manner of motion prediction in the modification of Figure 9; 

Figure 1 1 shows a unit block for DCT of the frame processing mode/field processing mode for another typical for- 
mat of a digital VTR; 

Figure 12 shows another modification of Figure 7; 
30 Figure 1 3 shows a set of macro-blocks; 

Figure 14 shows the manner of processing in accordance with the frame processing mode with Figure 13; 
Figure 15 shows the manner of processing in accordance with the field processing mode with Figure 13; 
Figure 16 shows a nrxxliflcation (for fbnvard prediction) of extension bit addition in the encoding device of second 
embodiment; 

35 Figure 1 7 is a block diagram showing an arrangement of a decoder which is a counterpart of the encoding devices 
of first and second embodiments; 
Figure 1 8 shows a picture of an odd cyde; 
Figure 19 shows a picture of an even cycle; 

Figure 20 is a block diagram showing a schematic arrangement of a high efficiency encoding device for picture sig- 
40 nals of a third embodiment; 

Figure 21 is a block diagram showing a schematic arrangement of a high efficiency encoding device for picture sig- 
nals of a fourth embodiment; 

Figure 22 is a block diagram sowing a schematic arrangement of a modification of the high efficiency encoding 
device for picture signals of third embodiment; 
45 Figure 23. is a flow chart for explaining a first modification of processing by limitation mode selecting means in the 
high efficiency encoding device for picture signals of the third embodiment; 
Figure 24 shows motion vectors from an odd field to an even field; 

Figure 25 is a flow chart for explaining a second modification of processing by limitation mode selecting means In 
the high efficiency encoding device for picture signals of third embodiment; 
so Figure 26 is a flow chart for explaining a third modification of processing by limitation mode selecting means in the 
high efficiency encoding device for picture signals of third embodiment; 

Figure 27 is a flow chart for explaining a fourth modification of processing by limitation mode selecting means in the 
high efficiency encoding device for picture signals of third embodiment; 

Figure 28 is a flow chart for explaining a fifth modification of processing by limitation mode selecting means in the 
55 high efficiency encoding device for picture signals of third embodiment; 

Figure 29 shows motion prediction for the second limitation mode and frame processing mode; 
Figure 30 shows motion prediction for the second limitation mode and field processing mode; 
Figure 31 shows motion prediction for the first limitation mode; 
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Figure 43 is a block dianram ch J P'^eo'cnon in the sixth encoding device; 

Figure 45 shows a date structure: and 

Figure 46 showrs a picture having a moving object. 
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DOT operation performed by DOT circuit 13, and an additive node 19. The additive node 19 adds an output of the 
Inverse OCT circuit 18 and an output of the frame memory group 20 fitted with the movement compensator. Meanwhile, 
signals for inhibiting overflow of the buffer 16 are fed back from buffer 16 to quantizer 14. 

[0035] On the other hand, picture data outputted from frame memory group 1 0 from one macro-biock to another are 
5 transmitted to a frame movement detection circuit 22 and a field movement detection circuit 21 . 

[0036] The frame movement detection circuit 22 detects and the motion vectors between frames and the sums of 
the absolute values of the differences between pixels from one macro-block to another and outputs these data, that is 
data of motion vectors between frames FMMV and the sums of the absolute values of the differences FMAD. The field 
movement detection circuit 21 detects the sums of the absolute values of the differences of the pixels from one macro- 
10 block to another to output these data, that is data of motion vectors between fields FDM V and the sums of the absolute 
values of the differences FDAD. The motion vector data FMMV/FDMV of these motion vector detection circuits 21 . 22 
are transmitted to selector 24, while the data of the sum of tiie absolute values of the differences FMAD/FDAD are 
transmitted to the movement prediction mode decision circuit 23. 

[0037] The movement prediction mode decision circuit 23 decides, based on the data of the sums of the absolute 
15 values of tiie differences FMAD from frame movement detection circuit 22 and tiie data of the sums of the absolute val- 
ues of the differences FDAD from field movement detection circuit 21 . as to whether the movement prediction is to be 
made on the frame-by-frame basis or on the f ie!d-by-f ield basis at the time of the movement prediction at the frame 
memory group fitted with the movement compensator 20, and outputs data indicating a processing mode which is more 
advantageous or efficient. Specifically, if the difference between the sums of the absolute values of the differences 
20 FMAD and FDAD is found to be larger than a predetermined threshold T1 (FMAD - FDAD > T1) by the movement pre- 
diction mode decision unit 23, data indicating that the field-by-field movement prediction is more efficient (data MPFD 
for the field processing mode for movement prediction) is outputted from circuit 23. Conversely, ii the difference between 
the sums of the absolute values of the differences FMAD and FDAD is found to be smaller than or equal to a predeter- 
mined threshold T1 (FMAD - FDAD ^@T1), data indicating that the frame-by-frame movement prediction is more effi- 
25 cient (data MPFM for the frame processing mode for movement prediction) Is outputted from circuit 23. The outputted 
movement prediction mode data MPFM/MPFD is transmitted to the frame memory group 20 fitted wit movement com- 
pensator which then effectuates frame-by-frame or field-by-field movement compensation. The movement prediction 
mode data MPFM/MPFD are also transmitted to selector 24. 

[0038] The selector 24 selects, responsive to the motion prediction mode data MPFM/MPFD from motion prediction 
30 mode decision circuit 23, tiie frame-to-frame motion vector data FMMV supplied from frame motion detection circuit 22 
or the field-to-field motion vector data FDMV supplied from field motion detection circuit 21 . That is, if the motion pre- 
diction mode data is the data MPFD indicating tiie field prediction mode data MPFD, selector 24 selects and outputs 
the motion vector data FDMV from field motion detection circuit 21 , whereas, if the motion prediction mode data is tiie 
data MPFM indicating the frame prediction mode data MPFM, selector 24 selects and outputs the motion vector data 
35 FMMV from frame motion detection circuit 22. The motion vector data FMMV/FDMV, as selected by selector 24, is 
transmitted to the block-forming mode decision circuit 25. 

[0039] Tiie block-forming mode decision circuit 25 is also supplied with output data from the field memory group 1 0 
and the processing mode data MPFM/MPFD from motion prediction mode decision circuit 23. The block-forming mode 
decision circuit 25 receives the motion prediction mode data MPFM/MPFD and the motion vector data FMMV/FDMV 
40 and formulates a differential picture using pictures from the frame memory group 10. The circuit 25 also selects, based 
on the difference picture, the block-forming mode most suited to the picture processed by the DOT circuit 13. For the I- 
picture or t-frame, data of the picture of the frame memory group 10 (original picture) is employed in place of the above- 
mentioned differential picture. 

[0040] It is now assumed tiiat e.g. the macro-block of the differential picture is a macro-block shown for example in 
45 Figure 2. In the case of the l-picture, the macro-bk>ck is the macro-block of tiie original picture, in Figure 2. odd-num- 
bered lines o1 . o2, o3 .. oN, where N indicates 16 in the case of a macro-block, are indicated by solid lines, while even- 
numbered lines el , e2, e3, .... eN, where N indicates 16 in the case of a macro-block, are indicated by broken tines. The 
pixels of the even-numbered lines are indicated as e(i, j), while those of the odd-numbered lines are indicated as o(i, j). 
In tiie differential picture or original picture, tfiat is the picture of the l-picture, as shown in Figure 2. the difference EFD 
so of the field-by-field differential picture may be represented by the equation 1 , whereas the difference EFM of the frame- 
by-frame differential picture may be represented by tiie equation 2. 
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OCT circuit 13. That is. the mode decision circuit 43 decides which of the motion prediction being of the frame prediction 
nfiode and the Wock-tbrming mode being of the frame processing mode PDFM or the motion prediction being of the field 
prediction mode and the block-forming mode being of the field processing mode PDFD is more efficient. In other words, 
the mode decision circuit 43 has the combined functions of the prediction mode decision circuit 23 and the block-form- 
5 ing mode decision circuit 25. 

[0048] Meanwhile, the mode decision may be achieved in the same way as the decision of the nfiotion prediction 
mode and the block-forming mode in the Embodiment 1 . 

[0049] On the other hand, address generator 31 controls the frame memory group 10 to output the picture data 
stored therein in the form of macro-blocks in accordance with the aforementioned mode data PDFM/PDFD. That is, if 

10 the block-forming mode data is the data PDFM indicating the frame-by-frame encoding operation, address generator 
11 controls the frame memory group 10 to output macro-blocks in which scanning of even-numbered and odd-num- 
bered lines is alternated with one another. Thus the unit macro-block transmitted to DCT circuit 13 is constituted by the 
alternate even-numbered and odd-numbered fields. Conversely, if the block-forming mode data is the data PDFD indi- 
cating thefield-by-field encoding operation, address generator 31 controls the frame memory group to output odd-num- 

15 bered fields for the macro-block sequentially for one frame at the odd-numbered cycles and subsequently output even- 
numbered fields for the macro-block sequentially for one frame at the even-numbered cycles. Thus the unit macro- 
block, transmitted to DCT circuit 1 3 at the odd-numbered cycles, is constituted solely by the odd-numbered fields during 
the odd-numbered cycles and solely by the even-numbered f ieWs during the even-numbered cycles. However, the DCT 
circuit 13 effectuates DCT on the basis of the 8 ^ 8 pixel unit maao-blocks, as described previously. 

20 [0050] That is. since it is possible with the iaibove-described high effidenerenooding device for information signals, 
according to the above-described emlxxliments 1 and 2, to make a changeover between the frame prediction mode 
and the field prediction mode in the movement prediction and between the frame processing mode and the field 
processing mode In the block-forming for DCT on the macro-block basis, the encoding may be achieved most efficiently 
on the macro-block basis. 

25 [0051 1 Specifically, the motion prediction and DCT as described hereinbelow is effectuated by the encoding device 
of the embodiments 1 or 2 depending on the formats of e.g. the so-called digital VTR. 

[0052] In Figs. 6, 8 and 10. the fields making up a frame of the l-frame or l-picture are indicated as lo field (an odd- 
numbered field of the I-frame) and le field (even-numbered field of the l-frame), the fields making up the P-frame or P- 
picture are indicated as Po field (an odd-numbered field of the P-frame) and Pe field (even-numbered field of the P- 
30 frame), and the fiekfs making up the B-frame or B-picture are indicated as Bo field (an odd-numbered field of the B- 
frame) and Be field (e^en-numbered field of the B-frame). 

[0053] Meanwhile, the frame processing mode for block formation according to the embodiments 1 and 2 is that in 
which the odd-numbered fields and the even-numbered fields are combined to form the macro-block which is used as 
a processing unit. That is. the frame processing mode is that of forming a macro-block for each frame. On the other 

35 hand, the field processing mode for block formation is that in which the odd-numbered fields and the even-numbered 
fields each form macro-blocks which are used as processing units. That is, the field processing mode is that of forming 
a macro-block for each field. Consequently, with the l-frame, for example, the frame processing mode is changed over 
from the frame processing mode to the field processing mode or vice versa for each macro-block, 
[0054] Besides, with the high efficiency encoding device according to the embodiments 1 and 2, each frame Is 

40 divided, as long as the encoding operation is concerned, into odd-numbered cycles and even-numbered cycles, con-e- 
sponding to the periods of scanning of odd-numbered cycles and even-numbered cycles of the interlaced scanning, 
respectively 

[0055] Meanwhile, when handling the so-called 4:2:0 component digital VTR format with the embodiment 1, each 
macro-block is made up of luminance btocks YO, Y1, Y2 and Y3, each composed of odd-numbered fields and even- 

45 numbered fields, and colour difference blocks CbO and Cri , each composed of odd-numbered fields, If the block form- 
ing mode is the frame processing mode, and DCT is performed based on the above-mentioned unit blocks of the macro- 
block, as shown in Figure 7. Conversely, if the block forming mode is the field processing mode, each macro-block MB 
is made up of luminance blocks Y02o. Y13o composed of the odd-numbered fields, luminance blocks Y02e, Y13e each 
composed of the even-numbered fields and colour difference blocks CbO. Cri each composed of odd-numbered fields. 

50 and DCT is performed based on the above-mentioned unit blocks of the macro-block. 

[0056] As for the motion prediction for the embodiment of Figure 7. motion prediction MCP between the l-frame and 
the P-frame is possible for the frame predictive mode, as shown in Figure 8. On the other hand, motion prediction 
MCoPo between the lo field and the Po field, motion prediction MCoPe between the lo field and the Pe field and motion 
prediction MCePe between the le field and the Pe field become possible for the field prediction mode. That is, in Figure 

55 8. motion prediction and block formation may be present independently for the frame prediction/processing mode and 
for the field predictiony^jrocessing mode, such that a motion vector may be found for the frame prediction mode and two 
motion vectors may be found for the field prediction mode. 

[0057] Consequently, if. in the above-described embodiment 1 . the block-forming mode of the l-frame is the frame 
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to another. Convereely no data is transmSteri ri„Z "^'"3 are performed from one macro4)lock 

is performed for the aLrmt:^!^^^^^^ 

are performed from one macro-WocK to anoCclreirno da^^is ^ns^^^^ "'^'^ '^"^ ^""^'"^ 

'0 Es JCprSn^mSS^^^^ ^el'^^-^on n»de ofthe P- 

moHon vector MVP is detectrdSrng ^4 nlm^^^^^^ 'S he frame predicfion mode, the frame-to-frame 

erence picture. The rmcro-Wock cZos^f aS!if loTrS^^" 7^ ^^^^"^ P'°^^«) t^e ref- 

ence thereof from the original StS?eT^e5 ^ "'"^ ' 

for the present mode. Conversely, no data is transmitted during the even-numbered cycles 

rfipr:So"tc^:te:o^^^^^^^^^ 

between the le field and tl^e Po HeTJS)n^or 2So h 1"^ ''^ ^'^^ ^^^^^ ^VePo 
tor MVePe between the lefield aS^^e pT^SaTde^^^^ 

Pe field) as the reference pictures. to^leoM n^^rS^S^ -^ ° 'I*^ ^ ^ ««« and the 

20 the prediction for the even nunSrScTcS arbo^^^^^ 

numbered field and the od-numberS f iS wSJh pred'ctwns. such as a mean value of the prediction for the odd- 

P. is selected, and the dWerrelSS iLe o^^S SSfSI il' T """^^^ P^^'''*^ '""^ '''^ """^^ frame 
f«.m the fo and le fi^ds. as^rS^^tS S^e^":^ dSs'^^^S^^ "^'^'^ '^"^ 

the current mode. inversely, no data is transmitted for the even-numbered cycles of 



and lefiekte separated from one ano^r is a p^^^^^ macro4*Kk. constituted by the to 

bered cycles of the current mode, in the s^e as Sbte ' "° 

between the le field and the PoSrireJor MV^b^^^^^^^^^ "^^'Po 
tor MVePe between the le fieW and the pV«eld I?dL«rt^^^ 
35 Pe field) as the reference picLriTtSe ^!nuXr^^?^^^ ' V!?' '"^ ""'^ ''^ a™* 
the prediction for the even-numberS cycS^anS^mt SnI T ° '"^^ odd-numbered cycles, 

numberedfield and that for theaSSSdffo^^^^^ 

frame P. is selected, and the differencXm the lriS^^!! 9"'«*e least value of the predicted error from the current 
Pe fields, separated from each S te IZ^' uShe n ^ " ""^"ined from the Po and 

« from each other, as the reference LurrS!«;«!^^ the macro-block, combined from the to and le fields, separated 
rent mode. " ^^^^V- ^ata is transmrtted for the even-numbered cycles of L o^- 

tKmep^i^r^eTermrrL?^^^^^ 

« the B-f rame and a motion vector BiSvB bTe^^^he P ffame 12 II "^"^ '^''''^ '•fr^"'^ and 

cycle, using the temporally fon^ard and te^a^ JS.^r!^^^ '^^^ ^' "Id-numbered 

backward prediction and bdSnZSiS wS L!, 1 ^ "'^ *>™«'d P^^^'^^". 

last value of the estimated ert^l'^et' e^t^^^ which will give the 

encoded, using the macro^,locK composed of aJeS^'cSl nuS^M^nH P'**"^^ 

^ ^---e .r^da^is^nsmiSedforthfr^ur:^^^ 

tSdpr^orodtrteCratra^^^^^^^ 

reference pictures, and predictioTfe nldT^lVeVs^^S^TZrl^ r ^J^l ^"^^ as the 
respective motion vectors, namely a n^onZ^^^^^^ T l^ "^"'^ ^"^ even-numbered fields. The 
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field and a motion vector BMVeBe between the Pe field and the Be field are detected. The one of the prediction for the 
odd-numbered field, the prediction for the even-numbered field, and both predictions, for example, a mean value of the 
two predictions, by the respective vectors, which will give the least value of the predicted error from the current frame, 
is selected, and the difference from the original picture Is encoded, using the macro-block, composed of the lo and le 
5 fields or Po and Pe fields, as the prediction picture. Conversely, no data is transmitted for the even-numbered cycles of 
the current mode, 

[0066] If the block-forming mode for the B frame is the field processing mode, with the motion prediction being of 
the frame prediction mode, frame-to-frame motion vectors, namely a motion vector FMVB between the l-frame and the 
B-frame and a motion vector BMVB between the P-frame and the B-frame. are detected, for the odd-numbered cycles. 

10 using the temporally forward and backward pictures as reference pictures. The one of the fonvard prediction, backward 
prediction and bidirectional prediction, which is a mean value between the two predictions, which will give the least 
value of the predicted error from the current frame, is selected, and the difference from the original picture is encoded, 
using the above-mentioned macro-block, composed of odd-numbered and even-numbered fields, separated from one 
another, as a prediction picture. Conversely, no data is transmitted for the even-numbered cycles of the cun^ent mode. 

IS [0067] If the block-forming mode for the B frame is the frame processing mode, with the motion prediction being of 
the field prediction mode, the temporally fonvard and backward pictures are used for the odd-numt^ered cycles as the 
reference pictures, and prediction is made of the respective odd-numbered fields and the even-numbered fields. The 
respective motion vectors, namely a motion vector FMVoBo between the lo field and the Bo field, a motion vector 
FMVeBo between the (e f iekl and the Bo f ieki, a motion vector FMVoBe between the lo field and the Be f iekl. a motk>n 

20 vector FMVeBe between the le field and the Be field, a motion vector BMVoBo between the Po field and the Bo field, a 
motion vector BMVeBo between the Pe field and the Bo field, a motion vector BMVoBe between the Po field and the Be 
field and a motion vector BMVeBe between the Pe field and the Be field are detected. The one of the prediction for the 
odd-numbered f ieki, the prediction for the even-numbered field, and t>oth predictions, for ecample. a mean value of the 
two predictions, by the respective vectors, which will give the least value of the predicted error from the cun-ent frame. 

25 is selected, and the difference from the original picture is encoded, using the macro-blocK composed of the lo and le 
fields or Po and Pe fields, as the prediction picture. Conversely, no data is transmitted for the even-numbered cycles of 
the current mode. 

[0068] However, with the embodiment 1. motion prediction between lo and le fields, motion prediction between Po 
and Pe fields or motion prediction between lo and le f iekls or motion prediction between Bo and Be fields cannot be 

30 achieved, as may be seen from Figure 8. 

[0069] in such case, prediction from an odd-numbered field to an even-numbered field may be made in each picture 
by employing the embodiment 2. If the block-forming is of the frame processing mode, each of unit blocks of a macro- 
block MB, namely luminance blocks YO, Y1 , Y2 and Y3, each composed of odd-numbered and even-numbered fields, 
and colour difference blocks CbO, Cr1, each composed of odd-numbered fields, is processed with OCT for the odd- 

35 numbered blocks, as shown for example in Figure 9. If the block forming mode is the field processing mode, each of the 
unit blocks, that is the luminance blocks Y02o, Y13o of the odd-numbered field and the colour difference blocks CbO, 
Cr1 of the odd-numbered field, is processed with OCT for the odd-numbered cycles. Subsequently, the luminance 
blocks Y02e and Y13e of the odd-numbered fields are processed with OCT during the even-numbered cycles. 
[0070] With the present example, shown in Figure 9, motion prediction SMCI between the lo and le fields and 

40 motk^n prediction SMCP between the Po and Pe fields may be made in addition to the motion predictions MVP, MCoPo, 
MCoPe. MCePo and MCePe shown in Figure 9. 

[0071] Thus, in the embodiment 2, if the block forming mode for the l-frame is the frame processing mode, the lo 
and ie fields are combined for the odd-numbered cycles to form the macro-block and, for the odd-numbered cycles, for 
example, OCT, quantization and variable lengtii encoding are performed from one maao-biock to another. It is noted 

45 that OCT is performed on the above-mentioned 8 * 8 unit block basis. Conversely, no data is transmitted during the 
even-numbered cycles for the current mode. If the block-forming mode is the field processing mode, only odd-numbered 
fields of the macro-block are encoded in a similar manner for the odd-numbered cycles. In this manner, at a time point 
of completion of the odd-numbered cycle, the lo field in its entirety and a macro-block fraction of the le field by the frame 
processing mode are obtained at tiie decoder as later explained. For the even-numbered cycle of the l-frame. motion 

50 prediction is performed of tiie macro-block of the le field by the field processing mode, using the to field as a reference 
picture, and the motion vector SMVl as well as the difference from the prediction picture is encoded. 
[0072] If the current frame is the P-frame, the following operation is performed. If, for example, the block-forming 
mode for the P-frame is the frame processing mode and motion prediction is of the frame prediction mode, tiie frame- 
to-frame motion vector MVP is detected, using tiie fonwardpicture (l-frame picture) as a reference picture, for the odd- 

55 numbered cycles, and a difference from the original picture is encoded, using the macro-block composed of lo and le 
fields as a prediction picture. No data is transmitted for tiie even-numbered cycles for the cun^ent mode, in the same 
manner as above. 

[0073] If the block-forming mode is of the field processing mode, with tiie motion prediction being of the field pre- 
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reference pictures. The one of the predicton for T cSd n.S , ?^ ^ or the Po and Pe fields as 
both predictions, for example, a m^an ^ue S tTe .^ZJS^I "'"^f^" even-numbered fields and 

5 bered fields, is selectedTnd the differerxe t?eor,rl ,he o^rctZ^^^^^ 

cycles Of the current mode, the motion vector MVoPe bel^fen TTZ pTJ' even-numbered 

the le and Pe fields and the motion vector SMVP beieen J.e .2 «^ p^, ?h "^^ePe between 

field processing mode. The one of the prScfon foTr^Sd ? 1' '''''^'^ 'r^^cro^ocM of the 

fieWs and the prediction for the oM-nJ^SZusTi^^r^T f^''-**'" even-numbered 

w only «,th the even-numbered cycles) byte SpS^^^^^ Po field concerned 

Of the above-mentioned predirtlons. whS^ f^vfri^^T^^^^^ ' " 

thereof from the prediction picture is encoded «^ difference 

cu:rorjs:sra^^^^^^^^^^^ 

IB frame and a motion vector BmJb b^t^eenTe vector FMVB between the l-frame and the B- 

using torwa-d and backward pictures asrSl ence pS^^^^on: Z!' ^ T^"^ odd-numbered cycles, 
bidirectional prediction, that is a mean value ^B^1^a^!Z.^l P'"^'""""" "^^^^ f^^'<='^ ^ 
of the predicted error from the current frame in^!SSTr,d S^hI P;«"«'on8, which will give the least value 
picture is encoded. Conversely, no datartransSS ^e 1„ "!! <="^^e"t 

^ [0075] If the block-forming mode is thl Bl^!^^-^^ 
mode, prediction Of odd-nuS j^'^:^^^^ 

pictures is performed for the odd-numbjS ciS l^J^- T T'" ^"'^ "^"^'^ ^'^"^^ ^ ^efefence 
between the fo and Bo fieWs. a nJ^^^Jlt^^Z^^l^Z STbo'SS^' ""T" ^ 
the Pb and Bofields and a motion vector BMVeBo between thrpl ,„i^. M ^ ^"^^^^ between 

^ give the least value of the predicted enor^s^Z^T^^^ ^ "^^^ P'«*'=*on which will 

prediction and the predicted pictu^^is enc^ed ^ffhp !Lon ^"^ the selected 

motion vector FMV6Bebe^«eSeloandBet.?;!^^^^ 

BMVoBe between the Po and Be fields and thrrmtlo^^f^n ^.f^! ^ ^ '® ^"^ ^® motion vector 

the odd-numbered fields of the cun-ej iCSiatr^r^^ ^ f^'^^'on of 

30 fields, are additionally performed ^^\^lS^^ TT",^^.^^ 

. s?ed^rrnrm2:ssr^^^^^ 

nu^redf^dsandcolourd^ence^oc^SSrc;^^^^^^ 

tCL^^Li^is^iri^prgr?^^^^^^^^^^ 

Pe fields or motfon prediction between Bo arSe^SSS^rS^ ^^^^ Po and 

[0079] In such case, the embodiment 2 ml 1,! ^^^ *''® "^""6^ as above, 

frame processing mode the unrtS^'l'^ro^for ^ ''T"^^' " '"^^ ""^"^"^ »he 

difference blocks CbOI. Crt)1 . Cb23 each^olZ 1J ^TTZ^ ^3 and colour 

essed with DOT for the odd-numbered biodS'^Z^^f odd-numbered and even-numbered fields, are proc- 
processing mode, respective unTblcSs Sis le i^^^^^ 'lo"^"? ' " the «eld 

and the colour difference blocks OoSo an^^ C^^^ 

for the Odd-numbered cycles. Subs^uentlyThe SmSan?^^^^^ odd-numbered f ieWs are processed with DCT 

colour difference blocks Cb0123e aS ao^^^^^^^^ 

even-number cycles. composed of the even-numbered fiekls are processed with DCT for the 

tZJ t'?^^:^^: "^T^ '"^^ as that shown in Figure 12 

m Ji at^^^: a^ Sgr:eir;rerrde^hS s^er 't^^^^'-^* ^^^"^-^ 

prediction isperibrmed on the basis of the Wock MB ^'^''^ ^ "dement 

a certain macro-block MB(i. J) and anoSL^biS^^'MBSf ^^^^^^ '0^''^'^ motion prediction, 

and motfon prediction for the odti-nurriber^S^^ r^Zti 1' ^'S^ ^ macro-block set MBg 
formed of the macro^jlock set MBg P'**"^"'" even-numbered fields are p«r- 
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macro*lock MB(i. j). and macra-WocL. MB(i+l fa^ MBM im^^^^^ a niacro-blockMB(i. Rl) next to the 

10083] In the macro-block shown in Fiou p . belonging to the next line. 

^ Croi are processed w,;'1?Ct S^^^^^^^ 

.... MBO^I. and MB{i*l. Cons^ uently ^^thSm^p^el no ml n MB(i. j). MB(i. H). 

affected by the processing of other macto-blodcs Processing mode, processing of each macro-block is not 

KLtM^rd^^sro^^r;^^^^ 

fields and luminance blocks YOo. y^o^r^O^ZTrI^ Jii^ ^^'^ macro-blocks MBge of even-numbered 
are processed with DOT If the mac°^^^^^^^^^ 

14. the luminance blocks YOo. Y1o wi^^t'<Sd tfe^J^^^^ ^'^^ « "^^f'*^- » ^ ^'Q-e 

field luminance blocks of the macro-block MbH aS^rJS f^?^^ ® *® '"«*=r°*'o* MBg are made up of odd- 
colour difference blocks CbOlo C^JS^ni^^'!^ '""l?""" ^ macro-block MB(i+i . j) and the 
- ence blocks of the macro-bTock MB^ J aToS"iT^Z7ZTnT.r^°i: "^^ 

the luminance blocks YOo, Ylo within ir^en-f ieS nS^^^^^^ S"^"«r'y. 
field luminance blocks of the macro-blockMBf. i and^pL £^ " fl® macro4jiock MBg are made up of even- 
colour dWerence ttocks Cb01e. C^le^lfe^nTeW^^^^ 

ence blocks of the macro^,lock MB(i, j) and Jen-Sfd^21^iSL 'f^^^^ TJ""^^ "P °' ""O"' <i^- 

^0 10085] Asmaybeseenfromatove the^Zir^^ hf^^^^^ 

lows: in the preJnt encoding deS', ^ the m'acro-^^^^ OCT processing mod'i is as fol- 

mode and the DCT is of the frame pr«essing Zr^^^^^L'^JIl °' ^'^•"^ 

(original picture), extracted from a picturTdSc^t^rhrif^^ the predicted picture and an input picture 

reference frame, is processed v«/dct CScT c^efffciS^^ compensator 20 as a 

10086] If. in the macro-block MBfl i) Z a^,LZlZ ^ transmitted. 

processing mode. thed^erenSSen rpS^^ 
original picture and the odd-field motion vectwS encS^ L^^ 

the predicted pteture extracted from the ^Z^u,Z^^,^t^7"^'f^^'^^^^^ while the difference between 
motion vector are encoded for the macro-btockMBtr? " P^'* *^ ^^'^ 

SrocX'^^rLf^dSr^^^^^ 
out from the reference frame and the input Srthe^^SKr 1^^^ 

transmitted for the macro-block MB(i. j). ^Mifl^^r^b^J^ LTl '"^ ^^''^^ ^^^o^ are 
block MB(i+1, j) taken out from the refLncTframe arS tSe in^!^^ ^'1"*"^ ^ ™cro- 

10088] lUn the macro-block MB(i. j)TSon n?eJSr^^ 

field processing mode, a difference betare^ To^iS ?^ » processing mode and the DCT is of the 

field original picture, the frame ^^^3 tS mf^^^^^ ij^ ^ "] o^'-mbered field and the odd 

MB(i+i.j)aretransmittedforthemacro-blockMS!rwSem?dS^^ 

and the input picture is transmitted for the macro^lci^rMBr!;? 1 ' odd-numbered predicted picture 

[0089] Meanwhile, with the encoding device of the oreseiit «mhoHi«».- .u 

wa«l prediction and WdirecS pTeSc^o^srce piSo^^^^^^^ T'?"'' "^"^'^ 
viousframe are possible With theLard ^rSn ,^^^^^^ 

recognizing which of these predictions is uSTi^eS^^^^S^l^^ T^"^ bits useful for 

tion. that is for the fon«ard or backward direcfon S T^t^! '* ^ "it for one direc- 

from the odd-numbered f ieWs. it sufficrtoXcSlT^.To! " °^ backward predicton and 

ilarl,ifJeprediction«fromtheeven-?ul?edS^^^^^^^ 
ma.o-«o..type.Pbrbidirectionalpredic«on.bo.J^^^^^^^ 

SJclTl'naTwSr^^^ 

mode, it is necessary to append extension bte to th7mLr« ? ^ Prediction with the field prediction 

the field prediction iJode^e ^ tat rl T^^^r'JZ^ *° ^ ^^"^ ^ 

numbered field of the current frame That is ^ZZ^^^ numbered field, an even-numbered field or from an odd- 
ent trame. That b. since there is a prediction from the current frame in the forward fiewX 
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diction mode, one or two extension bits are required for expressing tliree predictions including odd- and even-numbered 
predictions by extension bits. On the other hand, for backward field prediction mode, since there are two predictions, 
that is prediction for odd and even numbers, 1 extension bit is required. For example, for forward prediction, a code 1 
for odd-odd-numbered field of a fonn^ard frame and, a code 01 for even-numbered field of a fonvard frame and a code 
5 11 for prediction from odd-numbered field of a rear frame are appended. For backward prediction, it suffices to append 
codes 1 and 0 for prediction from an odd-numbered field of a backward frame and tor prediction from an even-numbered 
field of a backward frame to the conventional macro-bit type. 

[0094] If the mode is the frame prediction mode, no extension bits are appended, so that the bit string is of the same 
style as the conventional bit stream (MPEG). For bidirectional prediction, both extension bits are appended for forward 
10 or backward prediction. 

[0095] The above applies to the P-frame as well. 

[0096] As a modification, the number of the extension bits can be reduced to one for fonward prediction. That is, in 
the even-numbered cycle for the field prediction mode, the number of bits may be reduced to two and the fonward pre- 
diction mode may be transmitted by one extension bit by abolishing prediction from the odd-numbered field furthest 

IS removed both temporally and spatially; as shown in Rgure 16. Specifically, for odd-numbered cycles and for forward 
prediction, it suffices to add codes 1 and 0 to the conventional macro-block type as extension bits in the case of predic- 
tion from an odd-numbered field of the fonward frame and an even-numbered field of the fonward frame. Similarly, for 
even-numbered cycles and for fonvard prediction, it suffices to add codes 1 and 0 to the conventional macro-block type 
as extension bits in the case of prediction from an odd-numbered field of the current frame and an even-numbered field 

20 of the fonward frame. Finally, for backwand predictionr it suffices to add codes'1 and 0 to the conventional macro-block 
type as extension bits in the case of predictkMi from an odd-numbered field of the backward frame and an even-num- 
bered field of the backward frame. 

[0097] The block diagram of Figure 1 7 shows a decoder (first and second decoding units) for picture signals as a 
counterpart device of the encoding device of the above described embodiments 1 and 2. The high efficiency decoder 

25 includes a variable length encoding circuit 51 for receiving and decoding coded data of a picture to be reproduced and 
the header information for outputting the detected motion vector information, the motfon prediction mode information 
indicating which of the frame-by-frame motfon compensation and the f ietd-by-f ieki motion compensation in a macro- 
block is more efficient, the block-forming mode information Indicating which of the block formation for frame-by-frame 
orthogonal transform and block formation for frame-by-frame orthogonal transform in a macro-block is more efficient, 

30 and a macro-block address increment in the macro-block header information. The high efficiency decoder also includes 
address generators 81 , 82 and 83 by calculating address increment values at frame buffers 61 . 62 and 64 storing pic- 
ture decoding data from the macro-address increment for finding leading addresses of the macro-blocks and supplying 
the leading addresses to the frame buffers 61 , 62 and 64, and motion compensation circuits 59, 60, 63, 65 and 66 for 
supplying the relative addresses of the macro-blocks other than the leading addresses to the frame buffers 61, 62 and 

35 64 for data accessing, receiving the detected motion vectors, motion prediction mode information and the block-forming 
mode information, executing the compensation between motion-compensated frames or fields in association with tiie 
mode infomnation and transmitting the motion-compensated picture information to the frame buffers 61 , 62 and 64. 
[0098] Referring to Figure 1 7, data encoded by the high efficiency encoding device of tiie embodiments 1 and 2 are 
transiently recorded on a storage medium, such as CD. The encoded data reproduced form CD is supplied via input 

40 terminal 50 to an inverse variable length encoding circuit 51 where the header information etc. are decoded from one 
sequence to another, from one frame group to anotiier and from one frame to another. The header information is 
decoded from one slice (maao-block group) to another. The quantization width is included in the slice header. The 
macro-block type indicating the macro-block addresses, frame processing mode/field processing mode and the decod- 
ing system is decoded from one macro-block to another. The quantization width is decoded at the time of the updating. 

45 [0099] Meanwhile, if the block formation in a macro-block is of the frame processing mode, the macro-block in its 
entirety is decoded for the odd-numbered cycle, while no data is decoded for an even-numbered cycle. If the block for- 
mation in a macro-block is of the field processing mode, only the block including odd-numbered f lekis in the macro- 
block is decoded for tiie odd-numbered cycle, wile the block including even-numbered fields is decoded for the even- 
numbered cycles. 

50 [0100] The picture information is decoded by a dequantizer 53 performing an operation which is the reverse of 
quantization and an inverse OCT circuit 54 performing an inverse DCT operation, and a decision is given by tiie macro- 
block type as to whether or not the infornnation is a differential information. D^ending on the results of decision, a mode 
switch 57 for changeover between addition or non-addition to tiie reference picture (or between non-intra/intra of MPEG 
coding) by an additive node 56. The decoded picture is entered to frame buffers 64 or 61 for tiie l-or P-frame (alterriately 

ss each time the l-frame or tiie P-frame s processed) and to frame buffer 62 if tiie current frame is the B-frame. Each frame 
buffer is composed of two field buffers and the odd/even field picture is stored separately in each of these field buffers. 
Recording in the frame buffers Is controlled by changing over a switch 58. 

[01 01 ] The addresses recorded in the frame buffer are supplied from an address generator. The address generator 
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«ttd pi*re 10 p«Le »?SSr2lS^e P«». h». th. relerenc fWd s added «, ihe moBooWln. 

Wion K^pensaltaMiid mZ. ™««" ^"Pensaion circuits change over «,e W 

6^ « ,« ^erZSr^^SSre.njrr'S 0' 

oeted b, a decoding s/sZSTetlS^SSc^r.Sf??' 'r'°"*'"«"*"*™"=««*°"»™W- 

i««d 0. in ihe decoding eec^ence <.^^S^^^T^ ol pteyba«pio<„.a 

rp?.e«*sr„rs?rss^~r^rKr«rs^ 
«e^=XTrcrsi:?H£rrr^^f^^ 

be reproduced by odd/even n^^^^^y^rZl t^S ? ^ high-quality moving picture may 

essed with the field processing moSTura S' n^.^«rL?T k """" ' ^' "^"^ « P'oc- 
the frame processing mode, at rwn reCe n F^^^^^^ 

even-numbered cycle, the stationary portion feTsho-^^^^^^ "^"^"'^ ^''^''^ ^"^^ ^"""9 *e 

grasping the macro-block add^ss OneVto tr^^s^S^^ L ^.T"""""** '^''^^^ "^^thods for 

cycle as described previoS ^he cth^m^^^^^ n^cro^ for each macro-block of the even 

processing mode irrfom«tion'during1he c^^^^^^^ P^o<=essinfl modefframe 
fie« processing mode from the string of efch pr^^Se 

Santarethauh^at^^^^^ 

width if the quantization width ^7JZZZ e^,r^^ "^^ quantization 

tionedodd-numberedcycte "***''^°'''™*'^-"*^"rt^'^^0"'^<«e-field data during the above-™^^^ 

S an rc^Va^a^rr i^^^^^^ ""2 '""'T' "^"^'"^ ^'^'^^^ cy<^-. 
vice versa on the macr(^Wa:k tel^^^ processmg mode is changed over to the field processing mcxle ot 

bered cycle are decided d^nnT:.:."!"!:.^^^^^^ ""^ ♦'^^ odd-numbered field and the even-num- 

widthforthe cycle is stored. aXeSorSnSloTL^^^^^^^^^ quantization 

the macro-blcik of the ftew7ociSSt^^^^ 

rsZr.r,SfSd^'ttai're^?i'sr"'r^^'^^ 

The-efcre. onl, " ^ 5 are opoiated In a sin,la, mamer. 

«on„«.o,i*^e«od4Xi2rsi^:,irssszs.rss 
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frame or a second limitation mode of inhibiting prediction of an even field of a current frame being encoded from an odd 
field of the same frame for the entire macro-blocks in one frame, whichever is more efficient, and an address generator 
35(a) for controlling a frame memory group to output odd-numbered field components of the entire macro-blocks ifxthe 
first limitation mode is elected for one frame or picture and subsequently to output even-numbered field components of 
5 the entire macro-blocks, as well as to sequentially output the macro-blocks, on the frame-by-frame basis, if the second 
limitation mode is selected, based on a frame constituted by odd-numbered and even-numbered field components of 
the macro-blocks as a unit. 

10113] That is, the high efficiency encoding device of the embodiment 3 includes, for encoding a moving picture 
having a frame made up of two frames, encoding means for dividing each of the blocks of the frame into an odd field 

10 (first field) and an even field (second field) and rendering the motion prediction of the first to second fields possible (first 
limitation mode) and for changing over between first and second field division/first and second field non-division on the 
macro-block basis by way of block formation (second limitation mode). These encoding means are changed over from 
frame to frame. A 1-blt information indicating these encoding means, that is the inforniation indicating the selected 
mode, is appended to the codes. 

15 [01 1 4] The block diagram of Figure 21 shows a high efficiency encoding device according to the embodiment 4. In 
this figure, the blocks indicated by the same numerals as those used in Figs.1 and 5 are operated in a similar manner. 
Therefore, only the blocks bearing different numerals from those used in Figs.1 and 5 are explained. The high efficiency 
encoding device of Figure 20 includes, besides the blocks bearing the same numerals as those shown in Figs.1 and 5, 
an encoding mode decision circuit 34(b) and a selector 24, as limitation mode selecting means, for selecting a first lim- 

20 itation mode of inhibiting encoding by the above-mentioned frame processing mode for all of the macro-blocks in each 
slice or a second limitation mode of inhibiting prediction an even field of a frame being encoded from an odd field of the 
same frame for the entire macro-blocks in one slice, whichever is more efficient, and an address generator 35(b) for 
controlling a frame memory group to output odd-numbered field components of the entire macro-blocks If the first limi- 
tation mode is selected for one frame or picture and to output even-numbered field components for the entire macro- 

25 blocks, as well as to sequentially output, if the second limitation mode is selected, the macro-blocks, by one slice at a 
time, based on a frame constituted by odd-numbered and even-numbered field components of all of the macro-blocks 
as a unit. 

[0115] That is, the high efficiency encoding device of the embodiment 4 includes, for encoding a moving picture 
having a frame made up of two frames, encoding means for dividing each of the blocks in the frame into an odd field 

30 (first field) and an even field (second field) for rendering the motion prediction of the first to second fields possible (first 
limitation mode) for changing over between first and second field division/first and second field non-division on the 
macro-block basis by way of block formation (second limitation mode). These encoding means are changed over from 
frame to frame. A 1-bit information indicating these encoding means, that is the information indicating the selected 
mode, Is appended to the codes. 

35 [01 1 6] Referring to the drawings, the embodiments 3 and 4 are explained in detail. 

[0117] Figure 20 shows a third high efficiency encoding device for picture signals according to the embodiment 3 
of the present invention. With the present encoding device, encoding is performed on the basis of macro-blocks each 
consisting in a two-dimensional array of plural pixels smaller in size than a picture. For example, each macro-trfock con- 
sists of 16 * 16 pixels in a spatial array of input picture data in a raster scanning sequence. 

40 [01 1 8] The high efficiency encoding device of the embodiment 3 includes a frame memory group 10 for storing, as 
an original picture, a frame (picture) consisting of plural unit blocks (macro-blocks) each consisting of 1 6 * 16 pixels, and 
motion detection means made up of a frame motion detection circuit 22 as means for detecting the sum of absolute val- 
ues of the pixels and motion vectors between the frames on the macro-block basis, and a field motion detection circuit 
21 for detecting on the macro-block basis, the sum of absolute values of the pixels and motion vectors between the 

45 fields, made up of even-numbered and odd-numbered scanning lines of the frame pixels. 

[0119] The device of the present embodiment also includes a frame/field mode decision circuit 33 made up of first 
mode selecting means and second mode selecting means. The first mode selecting means decides which of a frame 
prediction mode of carrying out motion compensation based on a frame in the macro-block or a field prediction mode 
of carrying out motion compensation based on a field In the macro-block is more efficient and selects the more efficient 

50 mode. The second mode selecting means decides which of a frame processing mode of forming blocks for carrying out 
orthogonal transform, such as DCT based on frame In the macro-block, of a field processing mode of forming blocks 
for canying out orthogonal transform, such as DCT. based on of a field in the macro-block Is more efficient for carrying 
out orthogonal transform, using the output information of the motion detection means and the first mode selecting 
means. 

55 [0120] Besides, the present embodiment 3 includes, in addition to the motion detection means and the frame/field 
mode decision circuit 33, a limitatfon mode decision circuit 34(a), as limitation mode selecting means, for deciding 
which of the second limitation mode of adaptively changing over the mode of block formation for orthogonal transform 
between the frame processing mode and the lietel processing mode on the basis of each macro-block in each frame for 
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encoding each macro-block in accordance With the selerterimnH«.«,4u • 

orthogonal transform of the entire rrr^c^^^^MTu^^J h °" °' '^''"'"a ^ ^ 

odd fields in the mac«>-blocks in an a^urtS^lS^ndirtn ^^^^^^^^^ "^"^'"S «««l'n9 

evenfields in the macro-blocks in an amTrrt cSe3fr^^^^^^ 
5 for encoding and selecting the more XTemSTo^^^^Se X ^"!? 'Jf^r '''''' ^^^"^ 

rod^:u^;rrs;rer;s^^^^^^ 

formation for orthogonal transform'betweeX SCri^ "3 Se andt ''""^'"^ '""^^ 
each macro-block in each frame for encodino each^cm h^?nT^ T P^^essing mode on the basis of 

tation mode of forming the blocks for oS^ZarlTfo^mX enti^^^ '^T" 
the field processing mode, encoding odd fLs in meZL« SL^^ macro-blocks in each slice in accordance with 
Odd-numbered cycles and encoding^„ n me ^ corresponding to one frame during 

even-numbered cycles is more effidSffo tJ^i g aS^^^ fra^edu^ 
'5 bered and even-numbered cycles mean the pe^s of ^'"^ "^^ ^W-""-"- 

laced scanning, respectively ^ ^""'"^ odd-numbered and even-numbered fieMs in inter- 

SngdX:L?D°^LTMra"fot^^^ "^^^"^ °' «"*«^'-nt 3. W«h the third 

to find cumulated data SFDArandTw^D^^^^ 
0 being an offset value, the s^nT^JZl^^IS^^^T^ ^-^''^^ ™AD . T. J 

[0123] Besides. v«th the third enSng ^IS^DTn^HI^- ? '? '""^^ 

are cumulated from slice to slice to^ cuS^ d^ ^FoTn . cc!!^""'^ ^'^ macro-block to macro-block. 

becomes smaller than FMAD + T T bZ anTff«f ^ 1 ° ^"^ cumulative data SFDAD 

_ «-t'^i«ationmodeisse.ect^%'im?ar7a^^^^^^^^^^^ 

> tion means selecting means of the embodiment 3 mh ihl ^^ZZ^ ! modification of mode decision in the limita- 
using a motion vector from tiie aJmS^ZuMulTJ^n,^"^ ""^^ made 

In Figure 24, the motion vector MV fraS S^IZ o thT^n 1ST. '"1°' 

[0124] In ttie flow chart of Figure 23 the nSiln l^il 1 "^'S"'® ''I' "^O" sector Mv1-2. 

frame. At step S22. a median vlTbS^riiThor^S "^^^^^^ fT"^. °' '^<=^°*'o<=»« the current 

vector is found in the following manne^^r^the hc^SlrcZS^n^^ ' '^'^ ^ of each motion 

of falling power. The value of the mid iatebieTS ^1^!^°" ^'^^^ ^e order 

nents is found in a similar manner ^ "^"^ ^« "V-/ ol the vertical conpo- 

SrhXrir^r^t^iL^^^^ 

entire picture. The magnHude r may be Z5 S^Sfe^ton "'^ ^ 

-|W|.7{/lf._.)^.(Mv_y)^ equatfona 

.fi„::.rarfrerrSsr^^^^^^ 

first limitation modes are selected if r Is notCe ^a^ceS^^^^^^^ '^spe^^y. the second and 

[0127] That is. the second limitation rnoTlnrt . ^"^ othen«ise. respectively 

old. respectively. "^^^ ^"^ '''^ ^''^ "^^e a« selected if r < threshold and r > ttiresh- 

are found from the even fieis to the (Si iS i^^^^^^ 

MV (Mv_x. Mv_y) of the horizontal arSTSS SrllnterSl^ ?c '"'"^ ^"'^ -""^'^ 

and the second limitation mode is selectSTttifX rTsm?^ 

limitation mode is selected ™" '"^^ ^ ^'^^^ ^"e. If othenwise, the first 

frame being encoded ^ *^ correlation between the odd and even fields of ttie current 

method is extended and used for selecting the frame s electing mode ^ P^'esent embodiment, this 
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depending on ftisvaue. Kn™ «?r,SStoa »J^''riJST°*'^''^™^ 

Kie oirrenl pioyre. to each « Ihe naa^-UM^t^^^^J^^ "Mtai vector snd 

the square sums Is seleoled "nmaiion modes,anaihelimilalion mode Mng Iha lesser values ol 

[01 37] The flow chart of Fiaure 27 is ^r^m^T , ^ * ^™ ^e'^cted. 

embodiment 3. The l.miil '^^^^^^^^ 

S'*T5,^sirth'^r°'^''^^^^^^ 

rentfrLAl^jSThlSrrJr.T^^^^^^ 

2 + offset, the f iret limitation mode Is sSSed an7« ^ ^ ^^r 2. If var 1 >- var 

[0139] In the fourth encS S v^r TfnS ?«r . ' ^ '"'^^ ^^'^^^^d. 

encoded tofind Var 1 and Var 2. Th.T;:., 1 '.'"L'^r"^ macro-blocks in the slice beina 

Var 2 + offset, the first limitation mode fe Sei^nH f ^ °^ '^"^"^ Var 1 and Var 2. If Var l <- 

^ [0140] Similarly, the ^ c^^F^T^-^'r^^ T^T^ '"^^"^ "^^ ^^'^^ed. 
means Of the embodiments. V^rtS J^e thK^ dSe ^S^^^^ "^^^ 
and the correlation between the first and^^d^irS Jl .T^ '"^^ "^'"9 the motion vector? 

macro-block. as found at step S31.^e»r^^iS?n?v2c^«T^^^^^ °' 
the following equations 4 and 5 hold- ^ "-yW- " *e motion vectors are (mv x, mvv) 

35 

n_x = /ni^_x / 7(r77v_x) + (mi/ y) ^ 

* equation 4 

« n_y = /r7v_y / + (mv _y) « 

* equations 

&mSSe^rrvr'»^Vi?nre,»rr^™*-''^««^'* 
equation 6, is denoted as R ^ °* °* *® macro-blocks num.MB. as indicated by the 

45 

^ =As_xf +lS_yf / num MB 

" Ssanil^orLtfsStrSerjeS;^:^^^^^ 

[0143] The limitation mode is set at steo SZ^^t «gnrf Kantly. the value R assumes a larger value. 

flow Chan Of Figure 27. For examote 7 0^07°":".!.?""°" "^''^ •'^^ « ^ Var 2 as found from the 
threshold, the second limitation .^e is sSeS^SdTll ^ 'r^.'" '"'''^"^ and R is not more than a certain 
^ [0144] Meanwhile, with the foul 'nSSLTce ^ r^^ 

selecting the limitation mode. If Var 2 is not more tt^S^ a ceiSin l!ln.H i '^^'"9 «"«^ed for 

[0145, ^e<^-eofthepresentembodimentinc.udesanaddressgeneratorirSogn^^^^^^ 
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Odd cycle or an even cycle and controlling the frame memory group 10 for outputBng the macro-blocks divided Into 
^ JH^^i^ ^ block-forming modes for orthogonal transform for the odd cycles if the limitation m«ie s 
Jes«5ond (imtejon mc^e and also controlling the frame memo^^ 
blojs in associa , on With the block-forming modes for orthogonal tran^^^^ 

mode .8 the first l,m.tat.on mode, and a frame memory group fitted with a motion compensator 20 as^tioJ cTZ^ 
saton means^ for receiving the processing mode information selected by the processing mode selecting means (frame 
mojon pred.ct.on frame orthogonal transform / f iekf motion prediction field prcxessing mode data) ZTS^e 
mohon-compensated interframe or interfield prediction responsive to the mode information °"^executngthe 

^^^!^.J!TJ!!^^'^Tl^"'^^^^' ^'^ ^"^^^ P^""^- '^"'^ '"fra-'^a-^e encoding (l-frame 
Z^^hi^^nt .T! '"J^'"^ °' ""-^"^'^^ ^"^ bidirectional interpicture coding (B-frame or B- 

fe^r * fi^^ ^ J^'^"'' • " ^"'^"^ 8 * 8 pixels, with I * 2 blocks, that 

IS 16 16 p.xels, making up each macro-block. uiai 

'^t!."*^'"^ °* embodiment 3. the above-mentioned first mode selecting 

Zri^Jfr^ Jf- '^r"^'**^ P^^''^^^ '"^'^ -"^e ^"^'^^^ "«>tion compensation 
whereas the above-ment.oned f.,st mode selecting means select which of the frame processing modeTthe SS 

s performed by the above-mentioned frame/fieW processing mode dedsfon circuit 33 

^ • « ° fu'°^'"^ ^^'^'"^ ♦^^'"^ accordance with one of the two procLss^g 

modes vvhich .s more eff .cent. That is, with the first limitation mode, direction into the blocks for orthogo^ Ji toSrr! 
Of the entire macrc^Wocks in each frame is carried out in accordance with the field processing rSde o^the Sd^ds 
ieS« i:!Z°*^.1''u'^ to one frame during odd-numSered cycl^ aX^S 
SSnurrler^ '\"'^''r corresponding to one frame during even-nuniered <^di^e 

Odd-numbered and even-numbered cycles mean the periods of scanning ol odd-numbered and even-numbered fields 

Zatn'S.rr' rT''''"''- ^^"^ ^ "«oro.block is enc^^Ty ad^^vSy 

IJcoSl «„^r^' "" T"" T"" '^''' ^ °* ^ "•"'*««on modes is more elfciert X 

encod.ng and the more efficient Lmitation mode is selected. 

I?l!?'v.- ^ ^V^' above-mentioned second limitation mode, the mode of dividing each frame into blocks with- 

tioned frame processing mode)isadaptively changed overtothe mode of di^^^^^ 

fields and dMding the fields into blocks followed by encoding (the above-mentfoned fi^d prSa^ing 7Te 

versa in suchamanner that the frame andfield processing modes are used foramacro-bto<J^S^ 
movements and a macro-block presenting significant picture movements, respectively ^ 

Sro«,2rr'"^'^:JI?^ processing mode is selected for the second limitatfon mode, motion prediction is 
from the pred.ction-coded p.cture .s processed with DOT. On the other hand, if the field processing mode is selert^^ 

ra,d3bii«rr'^''rTr''^^^ 

Zl^^T ^ °* ^"^ ^^"^ °* macro-blocks, and the differential picture from 

Z ^ n TZ"^^, prediction, interframe. Beades. with the second limitatfon mode, encoding is^Sm^«l S 
the odd-numbered cycles. Meanwhile, the second limitation mode may bedefinedas being in^^^^^ 

Ken fi^rvllwnr.lm "f '^'^^'^ ^"^^ « *at is between odd 

ana even Tieids within the same frame, cannot be made. 

[0152] In this consideration, with the first limitation mode of the embodiment 3. division into blocks of all of the 
n^cro-blocks within each frame for orthogonal transform is made with the field processing moc^TspeTcaty JrJy ll 
oddf«^ds in each macro-block are encoded for the odd-numbered cycles in an amount corresponding to oSamS 
suteequenfly the even fields in each macro-block are encoded for the even-numbered cycles in an aa^^^. 
-ng to one frame. Therefore, with the present first limitation mode, since the odd fields (first fieldnnnSSS 

sad from this that the first limitation mode is frame encoding with intra-frame interfield prediction 

In^rT^ V ^® ""^cro-blockdata are read from frame memory group 10. under control by 

ZtflfJ'T ^^""'""^^ *° « ^"^""^ <*«*«^or 12. Te diff^er^^e detX?2 is 

also supplied w.tfi motion-compensated picture data from the frame memory group fitted with motion conpensator 20 
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as later described and a difference therebetween is detected by the difference detector 12 

triable length encoding, such as Huffman ^Ing or ^^Sen^^inT ' ''"^"'"'"^ 

[0156] The frame memory group fitted with motion compensator 20 is supplied with quantized data from r,..-r*,.r 

I'lonX'e'^^fraTS:^^^^^^ 

mitted to frame memory fitted with motion compensator 20 The frame tTrnoVv mL^^^^^ " * 

now able to effect f rame-bv-frame or f iow h„ ♦ilw^^.- memory fitted with motion compensator 20 is 

MPFM/MPFDand JSJiirc^teVl*,^^^^^^^^ compensaton on the basis of the prediction mode data 
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orthogonal transform) . 

[0165] The output of the frame processing mode data MDFM or the field processing mode data MDFD from the 
frame/Field mode decision circuit 33 is responsive to the first limitation mode or the second limitation mode from the lim- 
itation mode decision circuit 34 (EN1/EN2). 

5 [0166] The limitation mode decision circuit 34 decides, using the macro-block based picture data as read from the 
frame memory group 10, which of the first and second limitation modes is more efficient for encoding, and outputs the 
encoding mode data EN1 or EN2 depending on the results of decision. Specrfically. the limitation mode decision circuit 
34 calculates the sum of the differences of absolute values of the pixels between the odd fields (first fields) and the even 
fields (second fields) of the frames to output the limitation nrKXle data EN1 indicating that the encoding under the second 

10 limitation mode is more efficient if the sum value is less than a certain threshold TO. that is if the picture experiences 
little motion, while outputting the limitation mode data EN2 indicating that the encoding under the first limitation mode 
is more efficient if the sum value is larger than the threshold TO, that is if the picture experiences acute motion. 
[0167] Meanwhile, the decision by the limitation mode decision circuit 34 may also be given using the motion vector 
data FDMV from the field motion detection circuit 21. That is, it Is also possible to select the second limitation mode if 

IS the motion vector data FDMV between the odd field and the even field is less than a certain threshold tO and to select 
the first limitation mode if the data FDMV is larger than the threshold tO. 

[0168] By the limitation mode data EN1/EN2 being transmitted from the limitation mode decision circuit 34 to the 
frame/field mode decision circuit 33, the frame processing mode data MDFM or the field processing mode data MDFD 
responsive to the encoding mode data EN1/EN2 is outputted from the frame/field mode decision circuit 33. 

20 [0169]* * "That is, if thie limitation mode data from the limitation mode'dedsibncircuit 34 is the data EN1 indicating the 
second limitation mode, the frame/field mode decision circuit 33 performs an operation of adaptively changing over the 
frame processing mode to the field processing mode or vice versa for each macro-block in one frame. Consequently, 
the frame/Field mode decision circuit 33 outputs the adaptively changed over frame processing mode data MDFM or 
field processing mode data MDFD. 

25 [01 70] Conversely, if the limitation mode data from the limitation mode decision circuit 34 is the data EN2 indicating 
the first limitation mode, the frame/field mode decision circuit 33 performs the operation of division into blocks of all of 
the macro-blocks in one frame for orthogonal transform iri accordance with the field processing mode. Consequently 
the field processing mode data MDFD is outputted from the frame/field mode decision circuit 33. 
[01 71 ] TTie frame/field orthogonal transform block-forming mode data MDFM/MDFD, outputted from the f rame/f ieW 

30 mode decision circuit 33, and the limitation mode data EN1/EN2 from the limitation mode decision circuit 34. are trans- 
mitted to the address generator 35 and to the frame memory group fitted with the motion compensator 20. Meanwhile, 
the processing mode data MDFM/MDFD. encoding mode data EN1/EN2 and the motion vector data FMMV/FDMV are 
also transmitted to the above-mentioned variable length encoding circuit 1 5. 

[0172] The address generator 35 controls the frame memory group 10 to output picture data of the macro-blocks 
35 divided into blocks in accordance with the processing mode data MDFM/MDFD and the limitation mode data EN1/EN2 
on the macro-block basis. Specifically, address generator 35 controls the frame memory group 10 to output macro- 
blocks divided into blocks in accordance with the block-forming mode for orthogonal transform (data MDFM/MDFD) for 
odd cycles if the limitation mode data EN1/EN2 is the data EN1 Indicating the second limitation mode, while controlling 
the frame memory group 10 to output macro-blocks divided into blocks in accordance with the field processing mode 
40 (data MDFD) for odd and even cycles if the limitation mode data EN1/EN2 is the data EN2 indicating the first limitation 
mode, 

[0173] In other words. If, with the second limitation mode having been selected and the limitation mode data EN1 
being supplied to address generator 35, the processing mode data is MDFM indicating the frame-by-frame DCT, 
address generator 35 controls the frame memory 1 0 to output macro-blocks in which even and odd fields are alternately 
45 scanned, that is frame-based macro-blocks each confined from odd and even fields, as shown in Figure 3. That is, 
address generator 34 controls the frame memory group 1 0 to divide a macro-block having lines 1 to 1 6 into lines 1 to 8 
and lines 9 to 1 6 and to output four of 8 * 8 blocks, as shown in Figure 3. 

[0174] On the other hand, if. with the second limitation mode having been selected and the limitation mode data 
EN1 being supplied to address generator 35, the processing mode data is MDFD indicating the field-by-fleld DCT, 

50 address generator 35 controls the frame memory 10 to output macro-blocks in which even and odd fields are scanned 
separately, that is separate field-based macro-blocks for even and odd fields, as shown in Figure 4. That is, address 
generator 34 divides the lines 1 to 1 6 into lines 1 , 3, 5, 7, 9, 1 3 and 1 5 (lines of the odd fields or the first fields) and lines 
2, 4. 6, 8. 10. 12, 14 and 16 (lines of the even fields or the second fields), as shown in Figure 4, and to output two 8 * 8 
blocks for each of these odd fields and even fields. 

55 [0175] On the other hand, if, with the first limitation mode having been selected and the limitation mode data EN2 
being supplied to address generator 35, address generator 35 controls the frame memory group 10 to output macro- 
blocks divided Into blocks in accordance with the f ieW processing mode for the odd and even cycles, as desaibed pre- 
viously That is, if the first limitation mode is selected, address controller 35 controls the frame memory group 1 0 so that 
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two 8 ^ 8 blocks (only luminance components, as described subsequently) are outputted at all times. Specifically, 
address generator 35 controls the frame memory group 10 so that the two 8 ^ 8 block macro-block) is outputted in an 
amount corresponding to one frame (one picture) only for odd fields during the odd cycles, while controlling the frame 
memory group 10 so that the two 8 8 block (macro-block) is outputted In an amount corresponding to one frame (one 

5 picture) only for even fields during the even cycles. 

[0176] The picture data outputted from the frame memory group 10 controlled by address generator 35 Is proc- 
essed with OCT by the DOT circuit 13. as described above. If. for example, the second limitation mode and the frame 
processing mode are selected. DOT circuit 13 effectuates OCT on unit blocks of 8 ^ 8 pixels as shown in Figure 3. If, for 
example, the second limitation mode and the field processing mode are selected, DCT circuit 13 effectuates DOT on 

10 unit blocks of 8 * 8 pixels as shown in Figure 4. If the first limitation mode Is selected, DCT circuit 13 effectuates DCT 
on the 8 * 8 pixel blocks only for odd fields during the odd cycles and on the 8 * 8 pixel blocks only for even fields during 
the even cycles. 

[0177] Besides, the prediction mode data MPFM/MPFD and processing mode data MDFM/MDFD from the 
frame/Field mode decision circuit 33, motion vector data FMMV/FDMV as selected by selector 24 and the limitation 
IS mode data EN1/EN2 from the limitation mode decision circuit 34 are also supplied to the frame memory fitted with the 
motion compensator 20. Thus the frame memory fitted with the motion compensator 20 is not only responsive to the 
prediction nrKxje data MPFM/MPFD of motion prediction, processing mode data MDFM/MDFD of DCT processing and 
to the encoding mode data EN1/EN2, but also effectuates motion compensation with the aid of the motion vector data 
FMMV/FDMV. 

20 [01 78] For the second limitation mode and the frame processing mode, motion detection of the P and B frames may 
be made from the fonnrard and backward frames, as shown in Figure 29. Thus, in the DCT circuit 1 3. a differential picture 
from the prediction-coded picture is processed with DCT by unit blocks of 8 * 8 pixels. In Figure 29. the fonfvard. cunrent 
and backward frames are shown, with the arrow indicating the motion vector and MB macro-blocks. 
[0179] For the first limitation mode and the field processing mode, motion detection of the P and B frames may be 

25 made from the odd and even fields (first and second fields) of the fbnfvard and backward frames fbr each of the odd 
fields and even fields, as shown in Figure 30. In Figure 30. odd and even fields of the forward, current and backward 
frames are shown, with the an-ow mark indicating the motion vector and MB macro-blocks. 

[0180] For the first limitation mode and the field processing mode, motion prediction of the odd and even fields of 
the macro-blocks is performed from the odd and even fields of the fonward and backward frames, as shown in Figure 
30 31 . Motion prediction between the fields in each frame is also made. Consequently, a differential picture from the pre- 
diction-coded picture is processed with DCT by the DCT circuit 13 by the unit 8*8 pixel blocks. In Figure 31 , odd and 
even fields of the fonward. current and backward frames are shown, with the arrow mark indicating the motion vector 
and MB macro-blocks. 

[0181] With the above-described high efficiency encoding device of the embodiment 3, high efficiency encoding is 
35 achieved by changing over between encoding without intra-frame interfield prediction and encoding with intra-frame 
interfleld prediction depending on the first and second limitation modes, that is on the degree of motion in the picture. 
Above all, the first limitation mode is effective for a frame with significant movement. 

[0182] Meanwhile, with the encoding device of the embodiment 3. the present code is realized by adding extension 
bits to the conventional maao-block type for interchangeabillty with the conventional system. 

40 [0183] That Is, in the embodiment 3, the macro-block type has three predictions, namely fonward prediction, back- 
ward prediction and bidirectional prediction. Since prediction from odd-numbered fields of the previous frame and pre- 
diction-coded fields of the previous field are possible with the fbnvard prediction, the present code is realized by 
appending extension bits useful for recognizing which of these predictions is used. Since there are two predictions, it 
suffices to add one bit for one direction, that is for the fon^^ard or backward direction. For example, if the prediction is 

45 forward or backward prediction and from the odd-numbered fields, It suffices to add a code 1 as an extension bit to the 
conventional macro43lock type. Similarly, if the prediction is from the even-numbered field, it suffices to add a code 0 as 
an extension bit to the conventional macro-block type. For bidirectional prediction, both extension bits are appended for 
both foHA/ard and backward predictions. 

[01 84] Meanwhile, for a frame prediction mode, no extension bits are appended, so that the bit string is of the same 
50 Style as the conventional bit stream (MPEG). 

[01 85] The above applies to the P-f rame as well. 

[0186] In the embodiment 3, similarly to the preceding embodiment, the macro-block type has three predictions, 
namely fbnward prediction, backward prediction and bidirectional prediction for e.g. the B-frame. If the prediction is the 
fonward prediction with the field prediction mode, it is necessary to append extension bits to the macro-block for allowing 
55 to recognize If. when the prediction is for fonvard prediction and the field prediction mode, the prediction is that from an 
odd-numbered field, an even-numbered field or from an odd-numbered field of the current frame. That is, since there is 
a prediction from the own frame in the forward field prediction mode, one or two bits are required for expressing three 
predictions including odd- and even-numbered predictions by extension bits. On the other hand, for backward field pre- 
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diction mode, since there are two predictions, that is prediction for odd and even numbers. 1 extension bit is required. 
[0187] If the mode is the frame prediction mode, no extension bits are annexed, so that the bit string is ot the same 
style as the conventional brt stream (MPEG). For bidirectional prediction, both extension bits are annexed for forward or 
backward prediction. 

[01881 "nie above applies to he P-frame as well. tu * • • 

101891 As a modification, the number of the extension bits can be reduced to one for fonward prediction. That is. in 
the even-numbered cycle for the field prediction mode, the number of bits may be reduced to two and the forward pre- 
diction mode may be transmitted by one extension bit by abolishing prediction from the even-numbered field furthest 
removed both temporally and spatially, shown by chain-dotted line, as in the embodiment shown in Figure 1 6. 
[01901 Figure 32 shows a typical an-angement of an encoding device of the second embodiment 3. In Figure 32. 
the same components as those shown in Figure 20 are denoted by the same reference numerals and detailed desaip- 

tion thereof is omitted for simplicity. ..... ^ 

[01911 The arrangement of the second embodiment 3 is a 3-pass encoding device n which three operations are 

earned out for processing each frame. . . . 

[0192] That is an operation by the above-described first limitation mode by a fixed quantization width with intra- 
frame interfield prediction is carried out for the first pass, and an operation by the above-described second limitation 
mode by a fixed quantization width without intra-f ieU interframe prediction is carried out fa the second pass. The oper- 
ation of the first and second passes in which a smaller number of bits have occurred is selected for the third pass which 
is carried out with a controlled quantization width. , ■ . , 

[0193] In the second embodiment 3. a macro-blodrunit 55. a changeover switch 57. a field block-forming transform 
circuit 56 and another changeover switch 58 are connected to a downstream side of the frame memory group 10. Pic- 
ture data from the frame memory group 10 is transmitted to a motion detection circuit 51 effectuating fame and field 
motion detection An output of the motion detection circuit 51 is transmitted to a processing mode decision circuit for 
selecting the framertield modes for motion detection and block division for orthogonal transform 52, frame memory 
group 20 and the variable length encoding circuit 15. 

[0194] Output mode data from the processing mode decision circuit 52 is transmitted to the frame memory group 
20 and the variable length encoding circuit 15. Of these data, field processing mode data are supplied to one input ter- 
minal of a two-input AND gate 53. An output of the changeover switch 59. which is changed over depending on the pas 
numbers 1 to 3 is supplied to the other input terminal of the AND gate 53. An output terminal of the 2-input AND gate 
is connected to movable terminals of the changeover switches 57. 58. 

[0195] Data of the number of the produced bits is outputted from the variable length encoding arcuil 15 and trans- 
mitted to a selecting circuit 60 for seleaing one ot the first and second processing modes with smaller number of pro- 
duced bits based on the data of the nunUer of the produced bits (circuit for deciding whether or not there is intra-frame 
interfield prediction between the fields in one frame). The stored volume data from buffer 16 is transmitted to the vana- 
ble length encoding circuit 15 and to one of the fixed terminals of the changeover switeh 61 . Fixed values of the first and 
second passes are supplied to the other fixed terminal of the changeover switch 61 . 

[0196] In the above-described second embodiment 3. the picture entered to terminal 1 is temporanly stored in the 
frame memory group 1 0. Frame or field data are fetched as required from the frame memory 10 and. using these picture 
data, the motion vector is found by the motion detector 51 . The processing mode decision circuit 52 gives a decision of 
the field/frame mode for each macro-block from the motion prediction residues from the motion detector 51 . The macro- 
block unK 55 connected to the downstream stage of the frame memory group 10, receives the information for the first, 
second and thiid passes, that is the information of the presence/absence of intra-frame interfiekJ prediction which is the 
above-mentioned second or first limitation mode, via changeover switeh 59. If the macro^Hock unit 55 has received the 
first limitation mode information, it transmits only the block of the odd field (first field) and subsequently transmits the 
even field (second field), while turning off the block division of the frame processing mode. The picture data the macro- 
blocks of virtiich are set to the frame processing mode based on the information of the second limitaton mode in the 
macro-block unit 55 is set to the block of the frame processing mode in the field block division conversion circuit 56. 1 
bit is added to the selected mode information for each frame. 

[0197] The block diagram of Figure 33 shows a decoder for picture signals. The third high efficiency decoding 
device includes inverse variable length encoding means for receiving and decoding encoded data of the playback pic- 
ture and the header information including detected motion vector information, processing mode information and limita- 
tion mode information and outputting the detected motion vector information, processing mode information and 
limitation mode information simultaneously with decoded picture data, address generating means for calculatng an 
address inaement value at a frame buffer storing the decoded picture date from the limitation mode information, finding 
a leading address of each macro-block and according the leading address to the frame buffer, and motion cornpensat- 
ing means for supplying the relative addresses of the macro-blocks other than the leading address, accessing the data, 
receiving the detected motion vector information, processing mode information and limitation mode information, execut- 
ing motion compensation in association vnth the mode information, and transmitting motion-compensated pictore sig- 
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nals to the frame buffer. 

[0198] That is, the high efficiency decoding device of the present embodiment is made up of an inverse variable 
length encoding circuit 51 for receiving and decoding encoded picture data and the header information including the 
detected motion vector information, block-forming mode information (processing mode information) and limitation mode 

5 information (limitation mode data) and outputting the detected motion vector information, prediction mode information, 
processing mode information and limitation mode information of the header infbmiation simultaneously with the 
decoded picture data, address generators 81, 82 and 83 for calculating address increment values at frame buffers 61, 
62 and 64 storing picture decoding data from the limitation mode data for finding the leading address of each macro- 
block and supplying the leading address to the frame buffers 61 , 62 and 64, and motion compensation circuits 59, 60, 

10 63, 65 and 66 for supplying the relative addresses of the macro-blocks other than the leading address to the frame buff- 
ers 61, 62 and 64 for data accessing, receiving the detected motion vector Information, prediction mode information, 
processing mode information and limitation mode information, executing prediction between the motion compensated 
frames or fields in association with the mode information and transmitting the motion-compensated picture information 
to the frame buffers 61 . 62 and 64. 

15 [0199] Referring to Figure 33, data encoded by the high efficiency encoding device of the embodiment 3 are tran- 
siently recorded on a storage medium, such as CD. The encoded data reproduced form CD Is supplied via input termi- 
nal 50 to an inverse variable length encoding circuit 51 where the header infomiation etc. are decoded from one 
sequence to another, from one frame group to another and from one frame to another. The header information is 
decoded from one slice (macro-block group) to another. The quantization width is included in the slide header. The 

2b macro-block type indicating the macro-block addresses, frame/field prediction mode, frame/field processing mode, 
encoding mode data and the decoding system is decoded from one macro-block to another. The quantization width is 
decoded at the time of the updating. 

[0200] Meanwhile, if the block formation in a macro-block is of the frame processing mode, the macro-block In Its 
entirety is decoded for the odd-numbered cycle, while no data is decoded for an even-numbered cycle. If the block for- 
25 mation in a macro-block is of the field processing mode, only the block including odd-numbered fields in the maao- 
block is decoded for the odd-numbered cycle, while the block including even-numbered fields is decoded for the even- 
numbered cycles. 

[0201] The picture information Is decoded by a dequantlzer 53 performing an operation which Is the reverse of 
quantization and an inverse DCT circuit 54 performing an inverse DCT operation, and a decision is given by the macro- 

30 block type as to whether or not the information is a differential information. Depending on the results of decision, a mode 
switch 57 for changeover between addition or non-addition to the reference picture (or between non-intra/intra of MPEG 
coding) by an additive node 56. The decoded picture is entered to frame buffers 64 or 61 for the l-or P-frame (alternately 
each time the 1-frame or the P-frame is processed) and to frame buffer 62 for the B-frame. Each frame buffer is com- 
posed of two field buffers and the odd/even field picture is stored separately in each of these field buffers. Recording in 

35 the frame buffers is controlled by changing over a switch 58. 

[0202] The addresses recorded In the frame buffers 61 . 62 and 64 are supplied from address generators 81 . 82 and 
83. The address generators 81 , 82 and 83 calculate an address increment value in the frame buffers 61 , 62 and 64 from 
the encoding mode data in the header information of the macro-block to find the leading address of each macro-block. 
[0203] The quantization width data is stored in a one-field memory 52: The quantization width data Is supplied to 

40 dequantizer 53 via switch 55 changed over depending on the output of the inverse variable length encoding circuit 51 . 
Since only the macro-block processed with the field processing mode is decoded for the even-numbered cycles, the 
macro-block address decoded for each macro-block, the macro-block type and the motion vector required by the pre- 
diction system indicated thereby are decoded and the differential picture from the reference field is added to the motion- 
compensated picture to produce the playt^ack picture. 

45 [0204] On the other hand, data of the frame buffers 64. 62 and 61 is motion-compensated by the motion compen- 
sation circuits 65, 66, 59. 60 and 63. At this time, the respective motion compensation circuits change over the frame 
motion compensation/field motion compensation (frame/field) depending on the block-forming rno6e at the time of the 
DCT operation. 

[0205] These motion-conrpensated pictures are transmitted to respective fixed terminals of changeover switches 
50 67, 68 and 71 . These changeover switches 67, 68. 71 are changed over for taking out the reference field or frame Indi- 
cated by the decoding system of the macro-block decoding type. The changeover switch 71 is supplied with an output 
of switch 67 and a signal which Is outputs of the changeover switches 67 and 68 added together by additive node 69 
and subsequently halved by a divider 70. An output of switch 71 is supplied to switch 57. 

[0206] Outputs of frame buffers 64. 61 ad 62 are supplied via changeover switch 72 to a display 73. The display 71 
55 Is supplied with the outputs of the changeover switch 72 which are changed over in the sequence of playback pictures 
instead of in the decoding sequence for producing an output picture. 

[0207] Meanwhile, with the resent enlbodiment. since only the macro-block processed with the field processing 
mode is decoded during the even cycle. It is necessary to know a macro-block address. There are two methods for 
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grasping the macro-block address. One is to transmit the address of the macro-block for each macro-block of the even 
cycle as described previously. The other method is to store the information of the one-field field processing mode/frame 
processing mode information during the odd-numbered cycle and to calculate the address of the macro-block in the 
field processing mode from the string of each processing mode. The former method has an advantage that it is unnec- 
5 essary to add memories, v^ereas the latter method has an advantage that the transmitted information is not increased. 
The same may be said of the quantization width if the quantization width is transmitted for each macro-block without 
storing one-field data during the above-mentioned odd-numbered cycle. 

[0208] The advantages of the fifth encoding device shown in Figure 34 are explained. In this figure, the blocks 
denoted by the same numerals as those of Figs.1 and 5 have the same function. Therefore, only the blocks denoted by 
10 different numerals from those of Figs. 1 and 5 are explained. 

[0209] The high efficiency encoding device of Rgure 34 includes, in addition to the blocks denoted by the same 
numerals as those of the high efficiency encoding device shown in Figs.1 and 5, an encoding mode decision circuit 
34(c) and a selector 24, as limitation mode selecting means, for selecting the first limitation mode of inhibiting the 
encoding of the entire macro-blocks in one frame by the above-mentioned frame processing mode or the second limi- 
ts tation mode of inhibiting prediction of the even field of the current frame from the odd field of the same frame in the 
entire macro-blocks in one frame, whichever is more efficient, selecting only the first limitation mode for the bidirectional 
predicted frame (B-frame) and inhibiting prediction of the even field from the odd field of the B-picture, and an address 
generator 35(c), as address generating means, for controlling the frame memory group to output odd field components 
of the entire macro-blocks and to subsequently output even field components of the entire macro-blocks in case of 
20 selection of the first limitation mode for one frameras well aslo output the macro-blocks sequentially by one slice at a 
time on the basis of the frame composed of the odd and even field components of the entire macro-blocks in case of 
selection of the second limitation nrxxie. 

[0210] It is assumed that, with the encoding device of the embodiment 5, the picture sequence in the display time 
is BOo, BOe, 11 0, He, B2o, B2e, P3o, P3e. B4o, B4e. P5o, P5e, .... as shown in Figure 35. 
25 [021 1 ] The code sequence or decoding sequence of the present embodiment is 1 1 o. 11 e. BOo. BOe, P3o, P3e. B2o, 
B2e, P5o, P5e, B4o. B4e. 

[021 2] Meanwhile, for decoding the codes by the second encoding device using a decoding device, playback is ren- 
dered possible by having three frame buffers, that is six fields, at the maximum. 

[0213] The operation of the decoding device having 3-frame frame buffers A, B and C is explained by referring to 
30 Figure 36. For using the frame buffers, the decoded pictures of the l-frames or P-frames are stored by alternately 
changing over between the frame buffers A and B. Display is made of the contents of the frame buffer opposite to that 
used for storage of the current frame and in the sequence of odd and even fields. In other words, for storing the picture 
in frame buffer A, the contents of the frame buffer B are displayed, whereas, for storing the picture in frame buffer B, the 
contents of the frame buffer A are displayed. Two frames need to be stored in the frame buffers so as to be used as 
35 reference frames for motion compensation of the B- or P-frames to be decoded subsequently. 

[0214] For decoding the B-frame, the decoded picture is stored in frame buffer C. Display is made of the contents 
of the frame buffer C in the sequence of the odd fields and the even fields. If decoding is performed according to such 
rule, the entire components of 110 and the decoded picture of the even components of the macro-t^locks of the frame- 
based block-forming frame-based prediction mode of lie are stored at time 1 , while motion compensation is made at 
40 time 1 e by referring to the contents of the frame buffer A at time 1 e and the decoded picture of the even field compo- 
nents of the macro-blocks of the field-based block forming field-based prediction mode of Me is stored at time 1e in 
frame buffer A. 

[0215] At time 10, and at time 1e, the odd and even components of frame buffer B are displayed, respectively. In 
the absence of the previous codes, the contents of the frame buffer B at this time point become indefinite. 

45 [0216] At this time 20. the pictures of the frame buffers A and B are motion-compensated, and the entire compo- 
nents of BOo and the decoded picture of the even field components of the macro-blocks of the frame-based block form- 
ing frame-based prediction mode of BOo are stored. At time 2e, the pictures of the frame buffers A, B and C are motion- 
compensated, and the decoded picture of the even field-based components of the macro-blocks of the frame-based 
block forming frame-based prediction mode of BOe are stored. 

50 [0217] At time 2e. the pictures of the frame buffers A. B and C are motion-compensated, and the decoded picture 
of the even field components of the macro-blocks of the frame-based block forming-based frame prediction mode of 
BOe are stored in the frame buffer C. 

[0218] At time 2o and at time 2e. the odd components and even components of the frame buffer C are displayed, 
respectively. 

55 [0219] When BOe is displayed, the odd cycle of the B-frame is being decoded, such that both the components of 
BOo and bOe are contained. Therefore, the picture components of BOe, decoded at this time, need to be stored for being 
displayed temporally posteriorly 

[0220] When BOe is displayed, the even cyde of the B-frame is being decoded, and the remaining components of 



24 



EP0577 36S B1 



BOe which has not been decoded during the odd cycle are decoded. Consequently, since It is necessary to make 
motion compensation of the pictures from BOo to BOe. the picture of BOo needs to be stored. 
[0221] Therefore, a one-frame frame buffer becomes necessary for the B-frame, such that a three frame buffer is 
required for decoding the codes formed by the second encoding device. 
5 [0222] With the fifth encoding device, as shown in Figure 37, the encoding mode of the B-frame is can-ied out only 
by dividing the field into blocks for field prediction, white prediction of an even field from an odd field of the B-frame Is 
inhibited. Thus, as shown in Figure 35. only BOo is decoded at time 2o and simultaneously BOo Is displayed. This pic- 
ture need not be stored because It is not used for subsequent motion compensation. 

[0223] At time 2e. only BOe is decoded and simultaneously BOe is displayed, so that BOe need not be stored. Con- 
10 sequently, the decoding device for decoding the codes prepared by the fifth encoding device need not be provided with 
the frame buffer C. Such codes may be decoded by a decoding device having only a 2-frame buffer, that is a four-field 
buffer, as shown in Figure 38. for enabling the size and costs of the decoding device to be reduced. 
[0224] At time 3o, the picture of frame buffer A is motion-compensated, and the entire components of P3o and the 
decoded picture of the even field components of the macro-blocks of the frame-based block forming frame-based pre- 
ys diction mode of P3e are stored in frame buffer B. At time 3e, motion compensation is made by referring to the contents 
of the frame buffers A and B and the decoded picture of the even field components of the macro-blocks of the frame- 
based block forming field-based prediction mode of P3e are stored in frame buffer B. 

[0225] At time 3e. the pictures of frame buffers A and B are motion-compensated, and the decoded picture of the 
even field components of the macro-blocks of the field-based block forming field-based prediction mode of P3e are 
20 stored in frame buffer B. 

[0226] At time 3e and at time 3e, odd components and even components of the frame buffer A are displayed, 
respectively 

[0227] Subsequently the decoding and display proceed in a similar manner. 

[0228] If the GOP sequence is BOo. BOe, Bio, B1 e, l2o, I2e. B3o, B3e, B4o, B4e. P5o P5e. as shown in Figure 39, 
25 that is, if decoding is performed so that there are two B-frames between I and P frames or between two B frames, 
decoding may be made by the same decoding device, If the above-described decoding sequence is used, as shown In 
Figure 38. 

[0229] The same may be said of a case wherein there are more than two B frames between frames or between two 

P frames. 

30 [0230] The advantages of the sixth encoding device, arranged as shown in Rgure 40, are explained. In this figure, 
the blocks denoted by the same numerals as those of Figs.1 and 5 have the same function. Therefore, only the blocks 
denoted by different numerals from those of Flgs.1 and 5 are explained. 

[0231] The high efficiency encoding device of Figure 40 includes. In addition to the blocks denoted by the same 
numerals as those of the high efficiency encoding device shown in Figs.1 and 5, an encoding mode decision circuit 

35 34(d) and a selector 24, as limitation mode selecting means, for selecting the first limitation mode of inhibiting the 
encoding of the entire macro-blocks in one frame by the above-mentioned frame processing mode in the entire macro- 
locks in one frame, or the second limitation mode of Inhibiting prediction of the even field of the current frame from the 
odd field of the same frame, whichever is more efficient, selecting only the first limitation mode for the bidirectional pre- 
dicted frame (B-frame). Inhibiting prediction of the even field from the odd field of the B-picture. and inhibiting prediction 

40 from an odd field of a frame which is to be a reference frame for fonward prediction for the B-picture. and an address 
generator 35(d). as address generating means, for controlling the frame memory group to output odd field components 
of the entire macro-blocks and to subsequently output even field components of the entire macro-blocks in case of 
selection of the first limitation mode for one frame, as well as to output the macro-blocks sequentially by one slice at a 
time on the basis of the frame composed of the odd and even field components of the entire macro-blocks in case of 

45 selection of the second limitation mode. 

[0232] It is assumed that, in the present enr4)odiment, the display time sequence Is BOo. BOe, Bio, B1e, l2o. I2e.. 
B3o. B3e. B4o. B4e. P5o P5e, .... as shown in Rgure 41. 

[0233] The coding sequence with the encoding device of the present embodiment Is l2o, I2e, BOo, BOe, Bio. Ble, 
P5o P5e, B3o. B3e. B4o, B4e... . 
50 [0234] With the sixth encoding device, shown in Figure 40. fonfl^ard prediction from an odd field of the B-frame. as 
used in the fifth encoding device, is inhibited, as shown in Figure 42. 

[0235] Consequently, the picture necessary for prediction may be decoded by a decoding device having a buffer 
provided with a frame (two fields) for backward prediction and a field for fbnward prediction, that Is a buffer for three 
fields, as shown in Figure 43. 
55 [0236] This will be explained by referring to Figure 41 . 

[0237] In using the frame buffer, decoded pictures of I- or P-frames are stored by changing over the field buffers in 
the sequence of the field buffers A. B. C, A, B. C, from field to field. When storage is Initiated at the field buffer C. the 
contents of the field buffer A are displayed. Similarly, when storage is initiated at the f leW buffer A, the contents of the 
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field buffer B are displayed, whereas, when storage is initiated at the field buffer B, the contents of the field buffer C are 
displayed. For decoding the B-frame, the encoded picture is not stored, but displayed instantly. 
[0238] If the decoding is continued in this sequence, the following operation is incun'ed. At lo, since storage is initi- 
ated at the field buffer A, the contents of the field buffer B are displayed. 
5 [0239] At le. since storage is initiated at the field buffer B, the contents of the field buffer C are displayed. If there is 
no previously decoded picture, the display contents become indefinite. 

[0240] At time lo, l2o in its entirety and even components of the macro-block of the frame-based block-forming 
frame-based prediction mode of I2e are decoded and stored in field buffers A and B, respectively. 
[0241 ] At time le, by motion-compensating the picture of the field buffer A, even confiponents of the macro-block of 
10 the field-based block-forming field-based prediction mode of I2e are decoded and stored in field buffer B. 

[0242] At time 2o. since the picture to be encoded is the B-frame. the pictures of the field buffers A, B and C are 
motion-compensated and BOo decoded. The decoded pictures are not stored but displayed instantly. The same may be 
said of BOe, B1o and B1e at time 2e. time 3o and at time 3e, respectively. 

[0243] At time 4o, since storage is initiated at field buffer C. the contents of the field buffer A are displayed. At time 
75 4e, since storage is initiated at field buffer A, the contents of the field buffer B are displayed. 

[0244] At time 4o, the pictures of the field buffers A and B are motion-compensated and P3o in its entirety and even 
components of the macro-block of the frame-based block-forming frame-based prediction mode of P3e are decoded 
and stored in field buffers C and A. 

[0245] At time 4e, by motion-compensating the pictures of the field buffers B, C and A, even components of the 
20 macro-block of the field-based Wock-fbrming field-based prediction mode off P3e are decoded and stored in field buffer 
A. 

[0246] It is seen from above that, with the sixth encoding device, decoding is made possible by a frame buffer for 
three fields, that is one and a half frame, so that the buffer employed in the decoding device may be reduced in capacity, 
as shown in Figure 43 and the decoding device may be reduced in size and costs. 
25 [0247] TTie output bit stream of the transmission buffer 16, shown in Figure 1 , is multiplexed with encoded audio 
signals, synchronization signals etc., added to by error correction code data and modulated in a predetermined manner 
before being recorded on a recording medium, such as an optical disc, tape or a semiconductor memory, by means of 
a laser beam. 

[0248] The bit stream is inputted to the decoder on a transmission medium, such as an optical disc. The playback 
30 data reproduced from the transmission medium is demodulated and corrected for errors. If the bit stream is multiplexed 
with audio signals, synchronization signals etc., it is separated from these signals. 

[0249] Although the bit stream outputted from the encoder is recorded herein on the optical disc, it may also be 
transmitted to a transmission channel for ISDN or satellite communication. 

[0250] With the above-described first and second high efficiency encoding devices, field-by-field moving pictures 
35 having little motion and/or acute motion may be processed efficiently on the field-by-field or frame-by-frame basis. 
Above all, with the second high efficiency encoding device, it is possible to predict an even-numbered field from an odd- 
numbered field of the current frame and to select the encoding with higher efficiency. Therefore, a high-quality moving 
picture may be reproduced by the high eff iciency decoding device of the present invention despite the small volume of 
the transmitted information. 

40 [0251 ] With the above-described third and fourth high efficiency encoding devices, since the frame prediction inhib- 
iting mode is changed over to the mode of inhibiting prediction of the even-numbered field from the odd-numbered field 
of the current frame or vice versa on the frame-by-frame or slice-by-slice basis, address generating means for encoding 
and address generating means for decoding may be simplified to enable the hardware to be reduced in size. 
[0252] With the fifth high efficiency encoding device, since the B-frame is processed in its entirety on the f ield-by- 

45 field basis, and the mode of inhibiting prediction of the even-numbered field from the odd-numbered field of the current 
frame is changed over on the frame-by-frame or slice-by-slice basis, it becomes possible to use the frame buffer having 
two frames or four fields for the decoding device. 

[0253] With the sixth high efficiency encoding device, it becomes possible to use the frame buffer having one and 
a half frame, that is three f iekis. 
50 [0254] The first to sixth decoding devices may be used in conjunction with the first to sixth encoding devices for real- 
izing high efficiency decoding. 

[0255] Since compressed data encoded by the above-described high efficiency encoding devices are recorded on 
the recording medium according to the present invention, it becomes possible to record more picture data, that is pic- 
ture data of longer time duration, on the recording medium. 

55 

Claims 

1. A picture signal encoding method for encoding interlaced picture signal data representing a sequence of pictures 



26 



EP0577 365B1 



providing a substantially continuous video iniage, comprising the steps of; 

receiving said picture signal data comprising a plurality of frames, each of said frames including first and sec- 
ond fields of picture data; 

dividing said picture signal data into maaoblocks. said macroblocks being formed of a two-dimensional an-ay 
of pixels: 

predictively encoding said interlace scanned picture data by adaptively selecting a field-base predictive encod- 
ing technique or a frame-base predictive encoding technique; 

selecting field-based or frame-based orthogonal transformation for each macro-block; and 
orthogonally transforming said picture signal data; 

wherein said step of encoding includes generating header information for the encoded picture data, the header 
information comprising information identifying the type of predictive encoding utilized for each respective mac- 
roblock, data to identify the type of orthogonal transformation utilized for each respective macroblock and mac- 
roblock address information indicating the respective location of each macroblock. 

2. A picture signal encoding method for encoding picture signal data according to claim 1 , wherein 

s aid header information is generated to include macroblock type information which Identifies the type of predic- 
tion associated with a respective macroblock 

3. A picture signal encoding method for encoding picture signal data according to claim 2, wherein 

the type of prediction identified by said macroblock type information includes one of intra-prediction, fbnward 
prediction, backward prediction and bi^lirectional prediction. 

4. An encoding apparatus for encoding interlaced picture signal data representing a sequence of pictures providing a 
substantially continuous video image, comprising: 

means (1) for receiving input picture data in the form of frames, each frame having a pair of fields; 
means (10, 1 1) for dividing said picture data into macroblocks, said macroblocks being formed of a two-dimen- 
sional array of pixels; 

predictive encoding means (20) for encoding said input picture data in accordance with a frame prediction 
mode or a field prediction mode, including first mode selecting means (23, 24) for selecting said frame or field 
prediction mode; 

transform encoding means (13) for encoding said first encoded data by frame-based ortiiogonal transformation 
or by field-based orthogonal transformation including second mode selecting means (25) for selecting said 
field- or frame-based ortiiogonal transformation mode; and 

a header generator operable to generate header infomiation for tiie respective macroblocks of the encoded 
picture data including data to identify the type of predictive coding for each macroblocK data to identify the type 
of orthogonal transformation for each macroblock and macroblock address information. 

5. An encoding apparatus according to claim 4, wherein 

said header generator is operable to generate header information that includes macroblock type information 
which identifies tiie type of prediction associated with a respective macroblock. 

6. An encoding apparatus according to daim 5, wherein 

the type of prediction identified by said macroblock type information includes one of intra-prediction, fonvard 
prediction, backward prediction and bi-directional prediction 

PatentansprQche 

1. Bildsignalkodier-Verfahren zum Kodieren verschachtelter Bildsignaldaten. die eine Folge von Bildern reprdsentie- 
ren, die ein im wesentiichen fortlaufendes Videobild bereitstellt, mit Schritten zum 

Empfangen der Bildsignaldaten, die eine Vielzahl von Vollbikjern umfassen, wobei jedes der Vollbilder erste 
und zweite Halbbilder aus Bitddaten enthalt. 
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Unterteilen der Bildsignaldaten in MakroblOcke. welche Makrobldcke aus einem zweidimensionalen Feld von 
Pixein gebildet werden, 

prddiktiven Kodieren der verschachtelt abgetasteten Bilddaten durch adaptives Auswdhlen einer halbbildba- 
sierten Prddiktiv-Kbdierungstechnik oder einer vollbildbasierten Rddiktiv-KodierungstechniK 
Auswdhien einer halbbitdbasierten oder vollbildbasierten Orthogonal-Transformation fOr jeden Makroblock und 
Orthogonal-Transformieren der Bildsignaldaten, 

wobei der Schritt zum Kodieren das Erzeugen von Vorsatzinfbrmation fur die kodierten Bilddaten enthdit, die 
umfasst: Vorsatzinlbrmation. welche die Art von Prddiktiv-Kbdierung kennzeichnet, die fur jeden jeweiligen 
Makroblock benutzt wird, Daten zum Kennzeichnen der Art von Orthogonal-Transformation, die fOr jeden 
jeweiligen Makroblock benutzt wird. und Makroblock-Adressinfbrmatioa die den jeweiligen Ort jedes Makro- 
blocks angibt. 

2. Bifdsignalkodier-Verfahren zum Kodieren von Bildsignaldaten nach Anspruch 1 . bei dem 

die Vorsatzinformation derart erzeugt wird, dass sie Makroblockartinformation enthdit, weiche die Art von Prd- 
diktion kennzeichnet, die einem jeweiligen Makroblock zugeordnet wird. 

3. Bildsignalkodier-Verfahren zum Kodieren von Bildsignaldaten nach Anspruch 2, bei dem die Art von PrSdiktion, die 
durch die Makrobiockarinformation gekennzeichnet wird, eine der Arten (ntra-Prddiktion, VonArdrts-Prddiktion, 
ROckwdrts-Pradiktion und Bidirektional-Prddiktion enthdit. 

4. Kodier-Vorrichtung zum Kodieren verschachtelter Bildsignaldaten, die eine Fblge von Bildern reprdsentieren, die 
ein im wesentlichen fortlaufendes VideobikJ bereitstelit, welche Vomchtung umfiasst: 

ein Mittel (1) zum Empfangen von Eingangs-Bilddaten in Form von Vollbitolern, wobei jedes VollbiM ein Paar 
von Halbbildern hat, 

ein Mittel (10, 1 1) zum Unterteilen der Bilddaten in Makrobldcke, welche Makrobldcke aus einem zweidimen- 
sionalen Feld von Pixein gebildet werden, 

ein Prddiktivkodier-Mittel (20) zum Kodieren der Eingangs-Bilddaten in Ubereinstimmung mit einem Vollbild- 
Prddiktionsmodus Oder einem Halbbild-Prddiktionsmodus, das ein erstes Modus-Auswahlmrttel (23, 24) zum 
Auswdhlen des Vollbild- oder Halbbitei-Prddiktionsmodus enthdit, 

ein Transformationskodierungs-Mittel (13) zum Kodieren erster kodierter Daten durch eine vollbildbasierte 
Orthogonal-Transformation oder durch eine halbbildbasierte Orthogonal-Transformation, das ein zweites 
Modus-Auswahlmittel (25) zum Auswdhlen eines halbbitd- oder vollbildbasierten Orthogonal-Transformations- 
modus enthdit, und 

einen Vorsatz-Generator, der betreibbar ist, Vorsatzinformation fur die jeweiligen MakroblOcke der kodierten 
Bilddaten zu erzeugen. die enthdit: Daten zum Kennzeichnen der Art von Prddiktiv-Kodierung f Qr jeden Makro- 
block, Daten zum Kennzeichnen der Art von Orthogonal-Transformation fOr jeden Makroblock und Makroblock- 
Adressinfbrmation. 

5. Kodier-Vorrichtung nach Anspruch 4, in der 

der Vorsatz-Generator betreibbar ist. Vorsatzinfbrmation zu erzeugen, die Makroblock-Artinlbrmation enthdit, 
welche die Art von Prddiktion kennzeichnet, die einem jeweiligen Makroblock zugeordnet wird. 

6. Kodier-Vomchtung nach Anspruch 5, wobei 

die Art von Prddiktion, welche durch die Makroblock-Artinformation gekennzeichnet wird, eine der Arten Intra- 
Prddiktion, Vonivdrts-Prddiktion, Ruckwdrts-Prddiktion und Bidirektional-Prddiktion enthdit. 

Revendicatlons 

1 . Proc6d6 de codage de signaux d'image destine k coder des donn^es de signaux d'image entrelac6e repr^sentant 
une s^uence d'images r^lisant une image vid^o pratiquement continue, oomprenant les stapes consistant d : 

recevoir lesdites donn^es de signaux d'image comprenant une plurality de frames, chacune desdites frames 
comprenant les premier et second balayages de frame des donn6es d'image, 

diviser lesdites donn6es de signaux d'image en macro-blocs, lesdits macro-blocs ^ant formes d'une matrice 
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bidimensionnelle de pixels, 

coder de faQon predictive lesdites donn^es d'image balay^e errireiac^e en s^lectionnant de fagon adaptative 
une technique de codage pr^ictif fondle sur un balayage de trame ou une technique de codage pr^ictif fon- 
dle sur une trame, 

5 s^lectionner une transformation orthogonaie fondle sur un balayage de trame ou fondle sur une trame pour 

cheque macro-bloc, et 

transformer par transformation orthogonaie lesdites donn^es de signaux d'Image. 

dans lequel ladrte 6tape de codage comprend la generation d'infbrmations d'en-t§te pour les donnees d'image 
cod6es, les informations d'en-t§te comprenant des informations identifiant le type de codage predictif utilise 
10 pour cheque macro-bloc respectif ; des donnees destinees k identifier le type de transformation orthogonaie 

utilisee pour chaque macro-bloc respectif et des informations d'adresse de macro-bloc indiquant I'emplace- 
ment respectif de chaque maao-bioc. 

2. Precede de codage de signaux d'image destine k coder des donnees de signaux d'image selon la revendicatlon 1 . 
IS dans lequel 

lesdites informations d'en-t§te sont generees de fagon k comprendre des informations de type de macro-bloc 
qui identif lent le type de prediction assode k un macro-bloc respectif. 

20 3. Procede de codage de signaux d'image destine k coder des donnees de signaux d'image selon la revendicatlon 2, 
dans lequel 

le type de prediction identif ie par lesdites informations de type de macro-bloc comprend une prediction parmi 
une intra-prediction, une prediction vers Tavant, une prediction vers Tarriere et une prediction bidirectionnelle. 

25 

4. Dispositif de codage destine k coder des donnees de signaux d'image entrelacee representant une sequence 
d'images fournissant une image video pratiquement continue, comprenant : 

un moyen (1) destine k recevoir des donnees d'image d'entree sous forme de trames. chaque trame conpor- 
tant une paire de balayages de trame, 

un moyen (10. 11) destine k diviser lesdites donnees d'image en macro-blocs, lesdits macro-blocs etant for- 
mes d'une mathce bidimensionnelle de pixels, 

un moyen de codage predictif (20) destine k coder lesdites donnees d'image d'entree conformement k un 
mode de prediction de trame ou k un mode de prediction de balayage de trame, comprenant un premier moyen 
de selection de mode (23, 24) destine k seiectionner {edit mode de prediction de trame ou de balayage de 
trame, 

un moyen de codage par transformation (13) destine k coder lesdites premieres donnees codees par une 
transformation orthogonaie fondee sur une trame ou par une transformation orthogonaie fbndee sur un 
balayage de trame comprenant un second moyen de selection de mode (25) destine k seiectionner ledit mode 
de transformation orthogonaie fondee sur un balayage de trame ou sur une trame, et 
un generateur d'en-t§te pouvarrt §tre mis en oeuvre pour generer des informations d'en-t§te pour les macro- 
blocs respectifs des donnees d'image codees comprenant des donnees pour identifier le type de codage pre- 
dictif pour chaque macro-bloc, des donnees pour identifier le type de transformation ortiiogonale pour chaque 
macro-bloc et des informations d'adresse de macro-bloc. 

Dispositif de codage selon la revendication 4, dans lequel 

ledit generateur d'en-tdte peut etre mis en oeuvre pour generer des informations d'en-t§te qui conprennent 
des informations de type de macro-bloc qui identif lent le type de prediction associe k un macro-bloc respectif. 

50 

6. Dispositif de codage selon la revendication 5, dans lequel 

le type de prediction identifie par lesdites informations de type de macro43loc comprend une prediction parmi 
une intra-prediction, une prediction vers I'avant, une prediction vers I'amere et une prediction bidirectionnelle. 

55 
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